Jul 27 19:05:19.209474 ip-10-0-140-57 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:05:19.556462 ip-10-0-140-57 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:19.556462 ip-10-0-140-57 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:05:19.556462 ip-10-0-140-57 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:19.556462 ip-10-0-140-57 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:05:19.556462 ip-10-0-140-57 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:19.556968 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.556518    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:05:19.561462 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561442    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.561462 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561459    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.561462 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561465    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561468    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561472    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561476    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561480    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561483    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561488    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561491    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561495    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561499    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561506    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561510    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561513    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561517    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561521    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561525    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561528    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561542    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561546    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.561649 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561550    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561554    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561558    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561561    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561566    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561570    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561574    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561578    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561582    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561586    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561590    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561595    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561599    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561603    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561608    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561615    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561622    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561627    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561632    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.562474 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561636    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561641    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561647    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561653    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561658    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561662    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561666    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561670    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561675    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561681    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561686    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561690    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561694    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561698    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561702    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561706    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561710    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561714    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561717    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561722    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.563264 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561726    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561730    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561735    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561738    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561742    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561746    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561750    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561755    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561759    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561764    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561768    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561772    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561776    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561780    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561784    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561788    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561792    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561796    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561801    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.564083 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561807    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561813    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561819    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561825    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561830    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561834    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561838    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561842    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561846    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561851    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561855    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561859    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561863    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561867    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561871    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561875    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561879    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561884    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.561888    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.564892 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563017    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563028    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563034    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563038    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563042    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563046    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563051    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563056    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563060    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563064    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563068    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563072    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563076    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563081    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563085    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563089    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563093    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563098    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563102    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563106    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.565710 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563111    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563115    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563119    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563124    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563128    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563132    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563136    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563141    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563145    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563149    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563153    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563157    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563162    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563166    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563170    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563174    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563178    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563182    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563187    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563191    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.566383 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563195    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563199    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563203    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563207    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563212    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563216    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563220    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563224    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563227    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563233    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563238    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563242    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563266    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563270    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563273    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563278    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563282    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563289    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563293    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.567065 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563297    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563301    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563305    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563309    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563314    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563318    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563322    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563326    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563330    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563334    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563338    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563342    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563346    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563350    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563356    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563364    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563368    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563374    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563380    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.567580 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563384    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563388    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563392    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563396    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563402    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563407    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563411    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563416    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563423    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563427    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563432    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563436    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563440    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563444    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563448    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563452    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563456    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563460    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563463    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.568104 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.563467    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564030    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564037    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564041    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564046    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564050    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564055    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564059    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564064    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564068    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564072    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564076    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564080    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564086    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564091    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564096    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564101    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564106    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564111    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.568593 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564115    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564119    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564125    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564130    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564139    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564143    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564148    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564152    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564156    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564160    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564164    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564168    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564172    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564176    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564180    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564184    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564188    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564192    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564196    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.569035 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564200    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564204    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564209    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564213    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564217    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564223    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564229    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564233    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564237    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564241    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564264    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564269    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564273    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564278    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564282    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564288    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564293    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564297    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564302    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564305    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.569520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564309    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564313    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564317    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564321    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564325    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564334    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564339    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564344    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564349    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564355    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564359    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564363    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564367    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564371    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564375    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564379    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564383    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564387    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564392    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564396    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.569974 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564400    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564404    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564408    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564412    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564416    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564420    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564424    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564430    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564438    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564443    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564447    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564451    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564455    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564459    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564463    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564467    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564471    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564475    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564479    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564483    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.570527 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564487    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.564491    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564585    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564595    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564605    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564611    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564618    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564623    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564629    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564636    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564640    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564645    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564650    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564655    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564660    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564665    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564669    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564674    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564679    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564685    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564692    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564697    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564702    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564707    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:05:19.571020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564712    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564718    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564722    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564727    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564731    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564736    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564740    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564745    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564750    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564755    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564761    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564766    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564770    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564774    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564778    2560 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564783    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564790    2560 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564795    2560 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564799    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564804    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564808    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564813    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564818    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564822    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564827    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:05:19.571592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564831    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564836    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564844    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564849    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564853    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564858    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564863    2560 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564868    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564873    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564878    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564883    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564888    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564892    2560 flags.go:64] FLAG: --help="false"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564897    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564901    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564906    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564910    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564915    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564921    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564925    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564929    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564934    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564939    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:05:19.572185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564943    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564948    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564952    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564957    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564961    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564966    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564970    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564974    2560 flags.go:64] FLAG: --lock-file=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564979    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564983    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564988    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.564996    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565001    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565006    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565010    2560 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565014    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565019    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565024    2560 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565028    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565034    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565039    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565045    2560 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565049    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565053    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565058    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:05:19.572765 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565062    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565067    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565071    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565076    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565086    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565091    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565095    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565100    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565104    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565112    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565116    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565120    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565124    2560 flags.go:64] FLAG: --port="10250"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565129    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565134    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e2de819333f9a346"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565139    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565144    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565149    2560 flags.go:64] FLAG: --register-node="true"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565153    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565159    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565164    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565168    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565173    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565179    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565183    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:05:19.573360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565188    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565193    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565197    2560 flags.go:64] FLAG: --runonce="false"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565202    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565206    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565211    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565215    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565220    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565224    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565229    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565233    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565237    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565242    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565266    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565271    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565276    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565280    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565284    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565293    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565297    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565302    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565308    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565312    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565316    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565320    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:05:19.573931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565325    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565330    2560 flags.go:64] FLAG: --v="2"
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565336    2560 flags.go:64] FLAG: --version="false"
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565343    2560 flags.go:64] FLAG: --vmodule=""
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565349    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565354    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565520    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565527    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565532    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565537    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565541    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565545    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565550    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565556    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565561    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565566    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565570    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565574    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565577    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565583    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.574524 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565588    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565593    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565597    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565602    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565606    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565610    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565614    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565618    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565623    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565626    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565630    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565634    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565639    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565643    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565647    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565651    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565656    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565660    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565664    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565668    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.575007 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565672    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565676    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565680    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565684    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565688    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565692    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565696    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565701    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565705    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565708    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565712    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565715    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565719    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565723    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565727    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565731    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565735    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565738    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565742    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565746    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.575518 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565752    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565756    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565760    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565764    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565770    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565774    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565778    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565782    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565786    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565791    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565795    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565799    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565803    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565807    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565811    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565815    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565819    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565823    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565827    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565831    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.575976 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565835    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565839    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565843    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565847    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565851    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565855    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565859    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565863    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565867    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565871    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565875    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565879    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565884    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565890    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565895    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565899    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565905    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565909    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565913    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565918    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.576473 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565922    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565926    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565931    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565935    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.565938    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.565946    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.571682    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.571695    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.571712    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.571718    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571766    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571770    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571773    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571776    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571780    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.576950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571782    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571785    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571787    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571790    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571792    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571795    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571797    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571799    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571802    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571805    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571807    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571809    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571812    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571814    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571817    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571819    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571821    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571824    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571826    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571828    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.577331 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571830    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571834    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571838    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571841    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571845    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571849    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571851    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571854    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571857    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571859    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571862    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571865    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571868    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571871    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571873    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571876    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571878    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571881    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571883    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.577804 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571885    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571888    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571890    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571893    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571895    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571897    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571899    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571902    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571905    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571907    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571910    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571912    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571914    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571917    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571919    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571921    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571924    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571927    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571930    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571934    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.578348 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571937    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571953    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571957    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571960    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571962    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571965    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571967    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571970    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571972    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571975    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571977    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571979    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571982    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571984    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571986    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571989    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571991    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571993    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571996    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.571999    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.578972 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572001    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572003    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572005    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572008    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572011    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572013    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572016    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572018    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572020    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572023    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572026    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572029    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572031    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572034    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.579530 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572038    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.572043    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572147    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572151    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572154    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572157    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572159    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572162    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572165    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572167    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572170    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572172    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572175    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572178    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572180    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:19.579858 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572183    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572186    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572190    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572193    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572195    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572198    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572200    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572202    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572205    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572207    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572210    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572212    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572215    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572217    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572220    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572222    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572225    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572227    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572230    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:19.580217 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572233    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572236    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572239    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572242    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572262    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572266    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572270    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572272    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572275    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572277    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572280    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572282    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572284    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572287    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572289    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572292    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572294    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572297    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572299    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572301    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:19.580680 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572303    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572306    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572308    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572311    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572313    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572315    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572318    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572320    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572322    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572326    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572328    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572330    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572332    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572335    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572337    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572339    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572342    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572344    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572346    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572349    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:19.581145 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572351    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572353    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572356    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572358    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572361    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572364    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572367    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572370    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572372    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572375    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572377    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572380    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572382    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572385    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572387    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572390    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572392    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572394    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572397    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:19.581662 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572399    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572401    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572404    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572407    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572409    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572411    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572414    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:19.572416    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.572421    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.572505    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.574363    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.575547    2560 server.go:1019] "Starting client certificate rotation"
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.575638    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.575681    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:19.582234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.577552    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:19.583844 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.583828    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:19.592454 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.592438    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:05:19.594177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.594164    2560 log.go:25] "Validated CRI v1 image API"
Jul 27 19:05:19.594895 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.594881    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:05:19.599014 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.598998    2560 fs.go:135] Filesystem UUIDs: map[19911fd3-e0a6-452d-ae43-e8c971e0d27c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e763d843-3de6-4efc-8efb-f172c00a513a:/dev/nvme0n1p3]
Jul 27 19:05:19.599058 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.599015    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:05:19.600211 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.600195    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:19.603972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.603870    2560 manager.go:216] Machine: {Timestamp:2026-07-27 19:05:19.602700098 +0000 UTC m=+0.290564531 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198632 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f56ffad542de77a9b06b39ed4d18 SystemUUID:ec24f56f-fad5-42de-77a9-b06b39ed4d18 BootID:d07fcf54-61e8-4862-b50d-b41a8d14de64 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:ee:89:41:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:ee:89:41:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:11:31:ba:84:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:05:19.603972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.603970    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:05:19.604060 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.604033    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:05:19.606801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.606780    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:05:19.606934 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.606804    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:05:19.607480 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.607470    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:05:19.607511 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.607484    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:05:19.607511 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.607491    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:19.608021 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.608011    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:19.608709 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.608700    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:05:19.610510 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610500    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:19.610644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610634    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:05:19.610671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610664    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:05:19.610702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610673    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:05:19.610702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610683    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:05:19.610702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610692    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:05:19.610702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.610700    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:05:19.611124 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.611109    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:19.611165 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.611139    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:19.613499 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.613483    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:05:19.616139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.615897    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:05:19.616139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.616010    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:05:19.617797 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617779    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617805    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617818    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617829    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617845    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617855    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617866    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:05:19.617869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617871    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617877    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617883    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617890    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617895    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617935    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:05:19.618142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.617941    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:05:19.620183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.620165    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:05:19.620272 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.620169    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:05:19.620324 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.620287    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:05:19.620828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.620814    2560 server.go:1268] "Started kubelet"
Jul 27 19:05:19.620918 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.620894    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:05:19.620968 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.620890    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:05:19.620968 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.620946    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:05:19.621474 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.621458    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctct4"
Jul 27 19:05:19.621527 ip-10-0-140-57 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:05:19.622574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.622526    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:05:19.623125 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.623111    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:05:19.625131 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.625106    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:05:19.626436 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.625602    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-57.ec2.internal.18c63af375710d54  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-57.ec2.internal,UID:ip-10-0-140-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-57.ec2.internal,},FirstTimestamp:2026-07-27 19:05:19.62078754 +0000 UTC m=+0.308651969,LastTimestamp:2026-07-27 19:05:19.62078754 +0000 UTC m=+0.308651969,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-57.ec2.internal,}"
Jul 27 19:05:19.628787 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.628773    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctct4"
Jul 27 19:05:19.628890 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.628875    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:05:19.628960 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.628937    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:19.629052 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.628976    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:19.629487 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629471    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:05:19.629667 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629650    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:05:19.629743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629670    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:05:19.629743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629678    2560 factory.go:55] Registering systemd factory
Jul 27 19:05:19.629743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629694    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:05:19.629865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629818    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:05:19.629865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629826    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:05:19.629865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629858    2560 factory.go:153] Registering CRI-O factory
Jul 27 19:05:19.629988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629873    2560 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:05:19.629988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629921    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:05:19.629988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629949    2560 factory.go:103] Registering Raw factory
Jul 27 19:05:19.629988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.629962    2560 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:05:19.630562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.630544    2560 manager.go:349] Starting recovery of all containers
Jul 27 19:05:19.633712 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.633682    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:05:19.633810 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.633797    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:05:19.641366 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.641349    2560 manager.go:354] Recovery completed
Jul 27 19:05:19.646971 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.646884    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.648666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.648650    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.648746 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.648674    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.648746 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.648686    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.649161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649148    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:05:19.649161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649161    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:05:19.649292 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649167    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.649292 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649176    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:19.649864 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649850    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.649915 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649876    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.649915 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.649885    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.650730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.650714    2560 policy_none.go:49] "None policy: Start"
Jul 27 19:05:19.650730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.650728    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:05:19.650796 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.650737    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:05:19.651625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.651616    2560 policy_none.go:47] "Start"
Jul 27 19:05:19.702767 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.702753    2560 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:05:19.702843 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.702783    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:05:19.702843 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.702796    2560 server.go:87] "Starting device plugin registration server"
Jul 27 19:05:19.703024 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.703011    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:05:19.703093 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.703025    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:05:19.703138 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.703099    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:05:19.703202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.703190    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:05:19.703275 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.703203    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:05:19.703599 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.703579    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:05:19.703666 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.703618    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:19.774066 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.774045    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:05:19.775326 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.775305    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:05:19.775383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.775344    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:05:19.775383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.775361    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:05:19.775474 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.775390    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:05:19.777581 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.777564    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:19.803108 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.803086    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.804167 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.804152    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.804259 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.804178    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.804259 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.804194    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.804259 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.804216    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.814384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.814338    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.814384 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.814355    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-57.ec2.internal\": node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:19.829739 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.829720    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:19.876297 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.876276    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"]
Jul 27 19:05:19.876370 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.876334    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.876994 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.876981    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.877035 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.877004    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.877035 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.877013    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.878201 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878190    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.878335 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.878384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878340    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.878831 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878817    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.878908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878829    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.878908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878838    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.878908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878852    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.879014 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878854    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.879014 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.878981    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.880093 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.880076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.880182 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.880100    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:19.880705 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.880689    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:19.880792 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.880715    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:19.880792 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.880727    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:19.908762 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.908740    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-57.ec2.internal\" not found" node="ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.912982 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.912968    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-57.ec2.internal\" not found" node="ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.929826 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:19.929807    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:19.931508 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.931489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.931572 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.931518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:19.931572 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:19.931534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e632274fa8a2f60e358928d1be8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"c8e632274fa8a2f60e358928d1be8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.030802 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.030776    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.031888 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.031932 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.031932 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e632274fa8a2f60e358928d1be8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"c8e632274fa8a2f60e358928d1be8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.032002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.032002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2b65a4e0e865e8e1e2b0351660e28c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal\" (UID: \"f2b65a4e0e865e8e1e2b0351660e28c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.032002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.031981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e632274fa8a2f60e358928d1be8d4d-config\") pod \"kube-apiserver-proxy-ip-10-0-140-57.ec2.internal\" (UID: \"c8e632274fa8a2f60e358928d1be8d4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.131491 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.131450    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.211712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.211699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.216385 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.216371    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:20.232182 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.232166    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.332710 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.332682    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.433160 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.433116    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.533628 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.533606    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.574872 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.574846    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:05:20.575191 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.574949    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:05:20.633097 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.633059    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:00:20 +0000 UTC" deadline="2028-01-12 12:52:29.362531015 +0000 UTC"
Jul 27 19:05:20.633097 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.633094    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12809h47m8.729440806s"
Jul 27 19:05:20.634184 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.634147    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.734913 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.734852    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.764003 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:20.763968    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e632274fa8a2f60e358928d1be8d4d.slice/crio-5bbf612f8bdb89b9eb3a3545680939218081119eea291320101d62e6cb22b702 WatchSource:0}: Error finding container 5bbf612f8bdb89b9eb3a3545680939218081119eea291320101d62e6cb22b702: Status 404 returned error can't find the container with id 5bbf612f8bdb89b9eb3a3545680939218081119eea291320101d62e6cb22b702
Jul 27 19:05:20.764234 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:20.764212    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b65a4e0e865e8e1e2b0351660e28c4.slice/crio-a351558d47c7f3aa6e41f8074f7131a8091a285ddbf71238f22f27d6e38cfee3 WatchSource:0}: Error finding container a351558d47c7f3aa6e41f8074f7131a8091a285ddbf71238f22f27d6e38cfee3: Status 404 returned error can't find the container with id a351558d47c7f3aa6e41f8074f7131a8091a285ddbf71238f22f27d6e38cfee3
Jul 27 19:05:20.768096 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.768080    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:05:20.778140 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.778099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" event={"ID":"c8e632274fa8a2f60e358928d1be8d4d","Type":"ContainerStarted","Data":"5bbf612f8bdb89b9eb3a3545680939218081119eea291320101d62e6cb22b702"}
Jul 27 19:05:20.779020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.779003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"f2b65a4e0e865e8e1e2b0351660e28c4","Type":"ContainerStarted","Data":"a351558d47c7f3aa6e41f8074f7131a8091a285ddbf71238f22f27d6e38cfee3"}
Jul 27 19:05:20.835667 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.835647    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.936043 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:20.936025    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:20.960459 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:20.960441    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:21.036256 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.036208    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-57.ec2.internal\" not found"
Jul 27 19:05:21.053456 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.053440    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:21.129492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.129472    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:21.140704 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.140686    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:21.142387 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.142376    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal"
Jul 27 19:05:21.150812 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.150800    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:21.212871 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.212837    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:21.612085 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.612059    2560 apiserver.go:52] "Watching apiserver"
Jul 27 19:05:21.621613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.621580    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:05:21.623010 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.622977    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-69d2k","openshift-ovn-kubernetes/ovnkube-node-pbvtv","kube-system/konnectivity-agent-cflrf","kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj","openshift-multus/multus-m94nw","openshift-multus/network-metrics-daemon-m8pqz","openshift-network-diagnostics/network-check-target-lrvxl","kube-system/global-pull-secret-syncer-dn6m2","openshift-cluster-node-tuning-operator/tuned-d5z9k","openshift-dns/node-resolver-n4fr9","openshift-image-registry/node-ca-kzcd5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal","openshift-multus/multus-additional-cni-plugins-mshqx"]
Jul 27 19:05:21.624539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.624515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.625819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.625803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.626964 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.626943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.627730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.627452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ws6vn\""
Jul 27 19:05:21.627730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.627506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.627730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.627620    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.628178 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.628157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.628340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.628309    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.628582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.628553    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.628889 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.628738    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xt2gt\""
Jul 27 19:05:21.629638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.629618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8dcc\""
Jul 27 19:05:21.629763 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.629668    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:05:21.629822 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.629791    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:21.629894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.629876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.631237 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.630600    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:05:21.632111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.631628    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:05:21.632111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.631818    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:05:21.632111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.631828    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2lmcz\""
Jul 27 19:05:21.632111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.631993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.632111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.632024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:05:21.632461 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.632225    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.632461 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.632415    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.632738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.632718    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:05:21.633103 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.633014    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.633103 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.633062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6vjb\""
Jul 27 19:05:21.633236 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.633162    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.633712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.633694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.633808 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.633758    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:21.634990 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.634969    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbbqc\""
Jul 27 19:05:21.635271 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.635247    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:05:21.636730 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.636705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:21.636825 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.636775    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:21.637862 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.637821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.639140 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.639121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.639275 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.639258    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:21.640152 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.640131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.640728 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.640711    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:05:21.640819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.640737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pv96r\""
Jul 27 19:05:21.640890 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.640876    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.640994 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.640980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:05:21.641212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c2042c-583a-4024-8930-e53191447a71-tmp-dir\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.641332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd9tf\" (UniqueName: \"kubernetes.io/projected/a7c2042c-583a-4024-8930-e53191447a71-kube-api-access-wd9tf\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.641332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-multus\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641288    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.641332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-system-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-etc-kubernetes\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-tmp\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ff28b5f-39bc-4a64-8120-d06805d36894-agent-certs\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-cnibin\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-device-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.641542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rknqz\" (UniqueName: \"kubernetes.io/projected/7eba6440-c8ef-4088-9aea-f34827909fb3-kube-api-access-rknqz\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cni-binary-copy\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqxtj\" (UniqueName: \"kubernetes.io/projected/22ed409a-4831-44b2-b2a7-180a31c6e6b7-kube-api-access-dqxtj\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-sys\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-var-lib-kubelet\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-os-release\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-kubelet\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641814    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-multus-certs\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-conf\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.641950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-lib-modules\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.641979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9v2w\" (UniqueName: \"kubernetes.io/projected/8c693612-fe82-440c-9a86-ebe0efb5520e-kube-api-access-v9v2w\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-bin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-modprobe-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642039    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgxf9\""
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-host\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7tfx\" (UniqueName: \"kubernetes.io/projected/b7faaa4a-ca5c-4358-9f57-231a2f312131-kube-api-access-x7tfx\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cnibin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-os-release\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-socket-dir-parent\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642350    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-daemon-config\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-run\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642456    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-netns\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-system-cni-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.642683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642549    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:05:21.645954 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.645934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.646222 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.642534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.646310 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.646310 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-hostroot\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.646443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-conf-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.646443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-systemd\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.646443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c2042c-583a-4024-8930-e53191447a71-hosts-file\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.646443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-kubernetes\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ff28b5f-39bc-4a64-8120-d06805d36894-konnectivity-ca\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-k8s-cni-cncf-io\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysconfig\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.646644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-tuned\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.646987 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.646925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.647043 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.647004    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:21.649379 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.649360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:05:21.649379 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.649377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:05:21.649576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.649559    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:05:21.649643 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.649607    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k8bt\""
Jul 27 19:05:21.651248 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.651192    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:21.674352 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.674319    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ls4td"
Jul 27 19:05:21.682028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.682002    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ls4td"
Jul 27 19:05:21.731410 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.731391    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:05:21.747680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-var-lib-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.747791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.747791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cnibin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-os-release\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-daemon-config\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cnibin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovn-node-metrics-cert\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747864    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-os-release\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-system-cni-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-conf-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.747945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-systemd\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-system-cni-dir\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747967    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c2042c-583a-4024-8930-e53191447a71-hosts-file\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-systemd\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-conf-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.747994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-kubernetes\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c2042c-583a-4024-8930-e53191447a71-hosts-file\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ff28b5f-39bc-4a64-8120-d06805d36894-konnectivity-ca\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-etc-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-kubernetes\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-systemd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-netd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-multus\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-system-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.748429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-multus\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-etc-kubernetes\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-etc-kubernetes\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-system-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-tmp\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6fb64f-8445-4e89-a2a3-c26659b8400d-serviceca\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-daemon-config\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dtm\" (UniqueName: \"kubernetes.io/projected/af1f0669-214e-4d18-aad2-9e59212a85af-kube-api-access-74dtm\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-env-overrides\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-cnibin\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rknqz\" (UniqueName: \"kubernetes.io/projected/7eba6440-c8ef-4088-9aea-f34827909fb3-kube-api-access-rknqz\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cni-binary-copy\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqxtj\" (UniqueName: \"kubernetes.io/projected/22ed409a-4831-44b2-b2a7-180a31c6e6b7-kube-api-access-dqxtj\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-cnibin\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748598    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-var-lib-kubelet\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-script-lib\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.749223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ff28b5f-39bc-4a64-8120-d06805d36894-konnectivity-ca\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-kubelet\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-var-lib-kubelet\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-conf\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-kubelet\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-host\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748679    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6fb64f-8445-4e89-a2a3-c26659b8400d-host\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9v2w\" (UniqueName: \"kubernetes.io/projected/8c693612-fe82-440c-9a86-ebe0efb5520e-kube-api-access-v9v2w\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-modprobe-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-host\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-conf\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysctl-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-dbus\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c2042c-583a-4024-8930-e53191447a71-tmp-dir\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-modprobe-d\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.748978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd9tf\" (UniqueName: \"kubernetes.io/projected/a7c2042c-583a-4024-8930-e53191447a71-kube-api-access-wd9tf\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-socket-dir-parent\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-run\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-netns\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-bin\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-run\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-socket-dir-parent\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-netns\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-netns\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749228    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c2042c-583a-4024-8930-e53191447a71-tmp-dir\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22ed409a-4831-44b2-b2a7-180a31c6e6b7-cni-binary-copy\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-hostroot\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-slash\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-node-log\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.749986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-hostroot\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.750912 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wsjx\" (UniqueName: \"kubernetes.io/projected/ca5f6c87-2d1c-4d40-8260-1c3226970cce-kube-api-access-2wsjx\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750021    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-multus-cni-dir\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-kubelet-config\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-k8s-cni-cncf-io\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysconfig\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-kubelet\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-config\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-iptables-alerter-script\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkqds\" (UniqueName: \"kubernetes.io/projected/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-kube-api-access-kkqds\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-k8s-cni-cncf-io\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ff28b5f-39bc-4a64-8120-d06805d36894-agent-certs\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.751582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-ovn\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-sysconfig\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-log-socket\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-tuned\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-device-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-device-dir\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-sys\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmdzx\" (UniqueName: \"kubernetes.io/projected/0e6fb64f-8445-4e89-a2a3-c26659b8400d-kube-api-access-bmdzx\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-systemd-units\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-os-release\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-sys\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-multus-certs\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-lib-modules\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7tfx\" (UniqueName: \"kubernetes.io/projected/b7faaa4a-ca5c-4358-9f57-231a2f312131-kube-api-access-x7tfx\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-host-slash\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.750969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c693612-fe82-440c-9a86-ebe0efb5520e-os-release\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-run-multus-certs\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7faaa4a-ca5c-4358-9f57-231a2f312131-lib-modules\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-bin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22ed409a-4831-44b2-b2a7-180a31c6e6b7-host-var-lib-cni-bin\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7eba6440-c8ef-4088-9aea-f34827909fb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.752726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.751409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c693612-fe82-440c-9a86-ebe0efb5520e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.753240 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.752983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-tmp\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.753955 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.753938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7faaa4a-ca5c-4358-9f57-231a2f312131-etc-tuned\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.754673 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.754649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ff28b5f-39bc-4a64-8120-d06805d36894-agent-certs\") pod \"konnectivity-agent-cflrf\" (UID: \"7ff28b5f-39bc-4a64-8120-d06805d36894\") " pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.758463 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.758341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqxtj\" (UniqueName: \"kubernetes.io/projected/22ed409a-4831-44b2-b2a7-180a31c6e6b7-kube-api-access-dqxtj\") pod \"multus-m94nw\" (UID: \"22ed409a-4831-44b2-b2a7-180a31c6e6b7\") " pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.759019 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.758992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd9tf\" (UniqueName: \"kubernetes.io/projected/a7c2042c-583a-4024-8930-e53191447a71-kube-api-access-wd9tf\") pod \"node-resolver-n4fr9\" (UID: \"a7c2042c-583a-4024-8930-e53191447a71\") " pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.759295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.759243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9v2w\" (UniqueName: \"kubernetes.io/projected/8c693612-fe82-440c-9a86-ebe0efb5520e-kube-api-access-v9v2w\") pod \"multus-additional-cni-plugins-mshqx\" (UID: \"8c693612-fe82-440c-9a86-ebe0efb5520e\") " pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.759837 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.759816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rknqz\" (UniqueName: \"kubernetes.io/projected/7eba6440-c8ef-4088-9aea-f34827909fb3-kube-api-access-rknqz\") pod \"aws-ebs-csi-driver-node-xl9zj\" (UID: \"7eba6440-c8ef-4088-9aea-f34827909fb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.760216 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.760194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7tfx\" (UniqueName: \"kubernetes.io/projected/b7faaa4a-ca5c-4358-9f57-231a2f312131-kube-api-access-x7tfx\") pod \"tuned-d5z9k\" (UID: \"b7faaa4a-ca5c-4358-9f57-231a2f312131\") " pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.851329 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-etc-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-systemd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-netd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6fb64f-8445-4e89-a2a3-c26659b8400d-serviceca\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dtm\" (UniqueName: \"kubernetes.io/projected/af1f0669-214e-4d18-aad2-9e59212a85af-kube-api-access-74dtm\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851418    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-etc-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-env-overrides\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-systemd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-script-lib\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6fb64f-8445-4e89-a2a3-c26659b8400d-host\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-dbus\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.851561    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.851627    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.351605188 +0000 UTC m=+3.039469626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-netd\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.851721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-netns\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-bin\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-slash\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-node-log\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wsjx\" (UniqueName: \"kubernetes.io/projected/ca5f6c87-2d1c-4d40-8260-1c3226970cce-kube-api-access-2wsjx\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-kubelet-config\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-kubelet\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-config\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-iptables-alerter-script\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.852036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkqds\" (UniqueName: \"kubernetes.io/projected/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-kube-api-access-kkqds\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-ovn\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-log-socket\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmdzx\" (UniqueName: \"kubernetes.io/projected/0e6fb64f-8445-4e89-a2a3-c26659b8400d-kube-api-access-bmdzx\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-systemd-units\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e6fb64f-8445-4e89-a2a3-c26659b8400d-serviceca\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-host-slash\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-var-lib-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852251    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovn-node-metrics-cert\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-script-lib\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e6fb64f-8445-4e89-a2a3-c26659b8400d-host\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-dbus\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-kubelet\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-log-socket\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.852624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-netns\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-cni-bin\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-node-log\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.851832    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-run-ovn-kubernetes\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22142470-fec9-41b3-99cb-44dee37382c6-kubelet-config\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.852930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovnkube-config\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-host-slash\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-systemd-units\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-host-slash\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-var-lib-openvswitch\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.853542    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.853593    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.353573826 +0000 UTC m=+3.041438246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:21.853671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-iptables-alerter-script\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.854456 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.853765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5f6c87-2d1c-4d40-8260-1c3226970cce-run-ovn\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.854456 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.854068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5f6c87-2d1c-4d40-8260-1c3226970cce-env-overrides\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.854952 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.854925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5f6c87-2d1c-4d40-8260-1c3226970cce-ovn-node-metrics-cert\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.860272 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.860238    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:21.860272 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.860260    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:21.860272 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.860274    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:21.860456 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:21.860346    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:22.360314741 +0000 UTC m=+3.048179161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:21.862776 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.862708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dtm\" (UniqueName: \"kubernetes.io/projected/af1f0669-214e-4d18-aad2-9e59212a85af-kube-api-access-74dtm\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:21.863277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.863258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmdzx\" (UniqueName: \"kubernetes.io/projected/0e6fb64f-8445-4e89-a2a3-c26659b8400d-kube-api-access-bmdzx\") pod \"node-ca-kzcd5\" (UID: \"0e6fb64f-8445-4e89-a2a3-c26659b8400d\") " pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:21.864355 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.864312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkqds\" (UniqueName: \"kubernetes.io/projected/6d3ff9ab-6be4-4619-91b1-a035e7f1f030-kube-api-access-kkqds\") pod \"iptables-alerter-69d2k\" (UID: \"6d3ff9ab-6be4-4619-91b1-a035e7f1f030\") " pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:21.864666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.864651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wsjx\" (UniqueName: \"kubernetes.io/projected/ca5f6c87-2d1c-4d40-8260-1c3226970cce-kube-api-access-2wsjx\") pod \"ovnkube-node-pbvtv\" (UID: \"ca5f6c87-2d1c-4d40-8260-1c3226970cce\") " pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.941032 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.941008    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d5z9k"
Jul 27 19:05:21.946188 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.946152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n4fr9"
Jul 27 19:05:21.957870 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.957848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:21.968579 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.968562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mshqx"
Jul 27 19:05:21.977063 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.977044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj"
Jul 27 19:05:21.983847 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.983823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m94nw"
Jul 27 19:05:21.989490 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.989472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:21.997054 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:21.997029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-69d2k"
Jul 27 19:05:22.002850 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.002830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzcd5"
Jul 27 19:05:22.355966 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.355887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:22.355966 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.355951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:22.356180 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.356059    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:22.356180 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.356097    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:22.356180 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.356132    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.35611207 +0000 UTC m=+4.043976490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:22.356180 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.356149    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.356140389 +0000 UTC m=+4.044004807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:22.457097 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.457067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:22.457298 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.457247    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:22.457298 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.457290    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:22.457298 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.457303    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:22.457518 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.457362    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.457341677 +0000 UTC m=+4.145206096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:22.652354 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.652323    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c2042c_583a_4024_8930_e53191447a71.slice/crio-407bc038f7a2731dd836c04c1df81adf8fdddb365901b20adf2bf01aca6c0f6e WatchSource:0}: Error finding container 407bc038f7a2731dd836c04c1df81adf8fdddb365901b20adf2bf01aca6c0f6e: Status 404 returned error can't find the container with id 407bc038f7a2731dd836c04c1df81adf8fdddb365901b20adf2bf01aca6c0f6e
Jul 27 19:05:22.653416 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.653386    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff28b5f_39bc_4a64_8120_d06805d36894.slice/crio-4362160c303d988fc782b83caa50b16b41688fd1a375257d10aa697cb74516ed WatchSource:0}: Error finding container 4362160c303d988fc782b83caa50b16b41688fd1a375257d10aa697cb74516ed: Status 404 returned error can't find the container with id 4362160c303d988fc782b83caa50b16b41688fd1a375257d10aa697cb74516ed
Jul 27 19:05:22.654164 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.654136    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eba6440_c8ef_4088_9aea_f34827909fb3.slice/crio-5dc7443a2fdf02134437a01da1090d48301718674d02af6eb0d62844165d6830 WatchSource:0}: Error finding container 5dc7443a2fdf02134437a01da1090d48301718674d02af6eb0d62844165d6830: Status 404 returned error can't find the container with id 5dc7443a2fdf02134437a01da1090d48301718674d02af6eb0d62844165d6830
Jul 27 19:05:22.656890 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.656860    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c693612_fe82_440c_9a86_ebe0efb5520e.slice/crio-f37016d4e2a3d0d34c7559300642827ce6becd7c48fb90d475cc3adb38580b44 WatchSource:0}: Error finding container f37016d4e2a3d0d34c7559300642827ce6becd7c48fb90d475cc3adb38580b44: Status 404 returned error can't find the container with id f37016d4e2a3d0d34c7559300642827ce6becd7c48fb90d475cc3adb38580b44
Jul 27 19:05:22.657306 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.657217    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ed409a_4831_44b2_b2a7_180a31c6e6b7.slice/crio-fcd8caa8f0429389a6d016780471c3b0ff980cb54a8c7c517df09d20903aba46 WatchSource:0}: Error finding container fcd8caa8f0429389a6d016780471c3b0ff980cb54a8c7c517df09d20903aba46: Status 404 returned error can't find the container with id fcd8caa8f0429389a6d016780471c3b0ff980cb54a8c7c517df09d20903aba46
Jul 27 19:05:22.657908 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.657861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6fb64f_8445_4e89_a2a3_c26659b8400d.slice/crio-e2e07236e7f3efce3b4b73056eff1871a4be8a2720aafbbbdd5c48fc3e1e00e1 WatchSource:0}: Error finding container e2e07236e7f3efce3b4b73056eff1871a4be8a2720aafbbbdd5c48fc3e1e00e1: Status 404 returned error can't find the container with id e2e07236e7f3efce3b4b73056eff1871a4be8a2720aafbbbdd5c48fc3e1e00e1
Jul 27 19:05:22.662157 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.659841    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5f6c87_2d1c_4d40_8260_1c3226970cce.slice/crio-d24bc8ef6a66d51b04f28002dcab0acedfef44d989e00b3692935a15894e969d WatchSource:0}: Error finding container d24bc8ef6a66d51b04f28002dcab0acedfef44d989e00b3692935a15894e969d: Status 404 returned error can't find the container with id d24bc8ef6a66d51b04f28002dcab0acedfef44d989e00b3692935a15894e969d
Jul 27 19:05:22.662157 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.661011    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7faaa4a_ca5c_4358_9f57_231a2f312131.slice/crio-32596bfe009da76e1d524944041cb1a26753d0108942276d3d3d3b4df4eabf37 WatchSource:0}: Error finding container 32596bfe009da76e1d524944041cb1a26753d0108942276d3d3d3b4df4eabf37: Status 404 returned error can't find the container with id 32596bfe009da76e1d524944041cb1a26753d0108942276d3d3d3b4df4eabf37
Jul 27 19:05:22.663687 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:22.663663    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3ff9ab_6be4_4619_91b1_a035e7f1f030.slice/crio-ec52a8489d33522f4d9cd55c193b630b0801bfa18b460f77d1eff447228f04d1 WatchSource:0}: Error finding container ec52a8489d33522f4d9cd55c193b630b0801bfa18b460f77d1eff447228f04d1: Status 404 returned error can't find the container with id ec52a8489d33522f4d9cd55c193b630b0801bfa18b460f77d1eff447228f04d1
Jul 27 19:05:22.684708 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.684676    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:22 +0000 UTC" deadline="2028-05-07 00:32:07.689726372 +0000 UTC"
Jul 27 19:05:22.684708 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.684708    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15581h26m45.005021937s"
Jul 27 19:05:22.776343 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.776178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:22.776423 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.776178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:22.776464 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.776436    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:22.776511 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:22.776491    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:22.783929 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.783905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m94nw" event={"ID":"22ed409a-4831-44b2-b2a7-180a31c6e6b7","Type":"ContainerStarted","Data":"fcd8caa8f0429389a6d016780471c3b0ff980cb54a8c7c517df09d20903aba46"}
Jul 27 19:05:22.785104 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.785074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerStarted","Data":"f37016d4e2a3d0d34c7559300642827ce6becd7c48fb90d475cc3adb38580b44"}
Jul 27 19:05:22.787249 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.787222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" event={"ID":"c8e632274fa8a2f60e358928d1be8d4d","Type":"ContainerStarted","Data":"f121227e9475fee00ed3169ad2ab44951cdebdb211fe348542181367e05fefd3"}
Jul 27 19:05:22.788822 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.788784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5z9k" event={"ID":"b7faaa4a-ca5c-4358-9f57-231a2f312131","Type":"ContainerStarted","Data":"32596bfe009da76e1d524944041cb1a26753d0108942276d3d3d3b4df4eabf37"}
Jul 27 19:05:22.790440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.790417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"d24bc8ef6a66d51b04f28002dcab0acedfef44d989e00b3692935a15894e969d"}
Jul 27 19:05:22.794664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.794633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzcd5" event={"ID":"0e6fb64f-8445-4e89-a2a3-c26659b8400d","Type":"ContainerStarted","Data":"e2e07236e7f3efce3b4b73056eff1871a4be8a2720aafbbbdd5c48fc3e1e00e1"}
Jul 27 19:05:22.795856 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.795828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj" event={"ID":"7eba6440-c8ef-4088-9aea-f34827909fb3","Type":"ContainerStarted","Data":"5dc7443a2fdf02134437a01da1090d48301718674d02af6eb0d62844165d6830"}
Jul 27 19:05:22.797111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.797088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cflrf" event={"ID":"7ff28b5f-39bc-4a64-8120-d06805d36894","Type":"ContainerStarted","Data":"4362160c303d988fc782b83caa50b16b41688fd1a375257d10aa697cb74516ed"}
Jul 27 19:05:22.798266 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.798240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n4fr9" event={"ID":"a7c2042c-583a-4024-8930-e53191447a71","Type":"ContainerStarted","Data":"407bc038f7a2731dd836c04c1df81adf8fdddb365901b20adf2bf01aca6c0f6e"}
Jul 27 19:05:22.799396 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.799375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-69d2k" event={"ID":"6d3ff9ab-6be4-4619-91b1-a035e7f1f030","Type":"ContainerStarted","Data":"ec52a8489d33522f4d9cd55c193b630b0801bfa18b460f77d1eff447228f04d1"}
Jul 27 19:05:22.801277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:22.801224    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-57.ec2.internal" podStartSLOduration=1.801213223 podStartE2EDuration="1.801213223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:22.801181897 +0000 UTC m=+3.489046364" watchObservedRunningTime="2026-07-27 19:05:22.801213223 +0000 UTC m=+3.489077664"
Jul 27 19:05:23.364635 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.364599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:23.364796 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.364654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:23.364796 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.364777    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:23.364923 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.364845    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:25.364824798 +0000 UTC m=+6.052689227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:23.365412 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.365342    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:23.365501 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.365440    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:25.365422139 +0000 UTC m=+6.053286583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:23.465676 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.465642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:23.465849 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.465795    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:23.465849 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.465841    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:23.465970 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.465855    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:23.465970 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.465915    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:25.465895399 +0000 UTC m=+6.153759833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:23.685671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.685600    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:22 +0000 UTC" deadline="2028-02-24 05:22:11.543967279 +0000 UTC"
Jul 27 19:05:23.685671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.685662    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13834h16m47.858309031s"
Jul 27 19:05:23.778840 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.778756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:23.778995 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:23.778887    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:23.811741 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.811705    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2b65a4e0e865e8e1e2b0351660e28c4" containerID="3c43e8597837d663c1109a09b071d1d945da089977b115f865595c06d2792c3b" exitCode=0
Jul 27 19:05:23.812638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:23.812608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"f2b65a4e0e865e8e1e2b0351660e28c4","Type":"ContainerDied","Data":"3c43e8597837d663c1109a09b071d1d945da089977b115f865595c06d2792c3b"}
Jul 27 19:05:24.776351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:24.776316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:24.776844 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:24.776455    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:24.776923 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:24.776852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:24.776979 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:24.776948    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:24.857374 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:24.856975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" event={"ID":"f2b65a4e0e865e8e1e2b0351660e28c4","Type":"ContainerStarted","Data":"c1c876ac8e34011673e10c44eb77c5ff207c42506f73e064151eb61d0ddbc51f"}
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:25.386070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:25.386175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.386316    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.386380    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:29.386357753 +0000 UTC m=+10.074222179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.386774    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:25.386861 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.386823    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:29.386808531 +0000 UTC m=+10.074672954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:25.487874 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:25.487306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:25.487874 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.487475    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:25.487874 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.487493    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:25.487874 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.487507    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:25.487874 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.487563    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:29.487544613 +0000 UTC m=+10.175409056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:25.779072 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:25.778987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:25.779539 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:25.779120    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:26.775963 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:26.775925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:26.776144 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:26.776084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:26.776566 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:26.776545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:26.776677 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:26.776657    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:27.776181 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:27.775635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:27.776181 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:27.775765    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:28.776300 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:28.776112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:28.776300 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:28.776257    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:28.776787 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:28.776729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:28.776858 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:28.776826    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:29.418870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:29.418923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.419017    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.419068    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.419091    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:37.419071915 +0000 UTC m=+18.106936334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:29.419146 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.419118    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:37.419102581 +0000 UTC m=+18.106967006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:29.520151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:29.520093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:29.520398 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.520251    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:29.520398 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.520293    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:29.520398 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.520306    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:29.520398 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.520369    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:37.520349234 +0000 UTC m=+18.208213668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:29.779996 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:29.779522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:29.779996 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:29.779631    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:30.776670 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:30.776636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:30.776818 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:30.776757    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:30.777089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:30.777075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:30.777164 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:30.777149    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:31.775893 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:31.775860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:31.776359 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:31.775986    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:32.776177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:32.776149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:32.776618 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:32.776293    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:32.776618 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:32.776341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:32.776618 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:32.776446    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:33.775823 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:33.775792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:33.775913 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:33.775895    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:34.775709 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:34.775652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:34.776145 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:34.775782    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:34.776145 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:34.775828    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:34.776145 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:34.775934    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:35.776536 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:35.776504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:35.776906 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:35.776626    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:36.775621 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:36.775585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:36.775830 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:36.775584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:36.775830 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:36.775696    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:36.775830 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:36.775797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:37.487368 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:37.487324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:37.487886 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:37.487384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:37.487886 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.487453    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:37.487886 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.487483    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:37.487886 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.487527    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:05:53.487506651 +0000 UTC m=+34.175371072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:37.487886 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.487543    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:53.487537005 +0000 UTC m=+34.175401422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:37.588060 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:37.588025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:37.588222 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.588199    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:37.588222 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.588219    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:37.588366 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.588228    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:37.588366 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.588289    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:05:53.588275271 +0000 UTC m=+34.276139691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:37.776466 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:37.776394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:37.776614 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:37.776504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:38.775740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:38.775704    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:38.776189 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:38.775745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:38.776189 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:38.775827    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:38.776189 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:38.775952    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:39.777144 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:39.777108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:39.777600 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:39.777204    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:40.776437 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:40.776404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:40.776619 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:40.776456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:40.776619 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:40.776525    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:40.776729 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:40.776662    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:41.776613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.776490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:41.777058 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:41.776718    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:41.896118 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.895910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"369eba4d0c16aad85f53b59b5adad7fa0b03ae210300bbac4c25a3105ad473ea"}
Jul 27 19:05:41.896232 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.896214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"cc9fa67adbd4a6f8baca0c6178f7b00105c09888e406677b9289496b7448e2df"}
Jul 27 19:05:41.897554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.897528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzcd5" event={"ID":"0e6fb64f-8445-4e89-a2a3-c26659b8400d","Type":"ContainerStarted","Data":"80c92915ce20a9f6d610e80b8d7add39f9fe7a502467ce02861a2a9b9c6249b6"}
Jul 27 19:05:41.899323 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.899224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj" event={"ID":"7eba6440-c8ef-4088-9aea-f34827909fb3","Type":"ContainerStarted","Data":"95e0b8c77ca6ec51835c6648e0664ee5b9b90a2f997ec953b4f58a280b52464b"}
Jul 27 19:05:41.900918 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.900895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cflrf" event={"ID":"7ff28b5f-39bc-4a64-8120-d06805d36894","Type":"ContainerStarted","Data":"4d69b1784d76000204851dc9620778b81376c7a09729fb2a2b749755671d8a80"}
Jul 27 19:05:41.902445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.902418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n4fr9" event={"ID":"a7c2042c-583a-4024-8930-e53191447a71","Type":"ContainerStarted","Data":"a8fe1eb5264ef56bf600557a6c7d73a74950da2fe010bf21015311fcd4ef2b00"}
Jul 27 19:05:41.905437 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.904988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m94nw" event={"ID":"22ed409a-4831-44b2-b2a7-180a31c6e6b7","Type":"ContainerStarted","Data":"fdc763dab71798e912f6f2c2ac283a985b9d39e499d7d543218ba9896bc24221"}
Jul 27 19:05:41.907637 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.907614    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="e8e82f9d8694a51effd2b699ff7c97bdea8f017b1d00495a41ef775829ec056a" exitCode=0
Jul 27 19:05:41.907712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.907686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"e8e82f9d8694a51effd2b699ff7c97bdea8f017b1d00495a41ef775829ec056a"}
Jul 27 19:05:41.909111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.909090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d5z9k" event={"ID":"b7faaa4a-ca5c-4358-9f57-231a2f312131","Type":"ContainerStarted","Data":"7daaff7f2a57c9c4e1dd0d048a0c31f6ed5635b93e6f0107cfdf626e57010ef8"}
Jul 27 19:05:41.912450 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.912408    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kzcd5" podStartSLOduration=3.044428422 podStartE2EDuration="21.912393369s" totalImagesPullingTime="18.867964947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.912083632 +0000 UTC m=+22.599948073" watchObservedRunningTime="2026-07-27 19:05:41.912393369 +0000 UTC m=+22.600257813"
Jul 27 19:05:41.912518 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.912497    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-57.ec2.internal" podStartSLOduration=20.912485173 podStartE2EDuration="20.912485173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:24.874744573 +0000 UTC m=+5.562609016" watchObservedRunningTime="2026-07-27 19:05:41.912485173 +0000 UTC m=+22.600349611"
Jul 27 19:05:41.928406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.928370    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d5z9k" podStartSLOduration=3.060492222 podStartE2EDuration="21.928359015s" totalImagesPullingTime="18.867866793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.928327717 +0000 UTC m=+22.616192155" watchObservedRunningTime="2026-07-27 19:05:41.928359015 +0000 UTC m=+22.616223452"
Jul 27 19:05:41.945680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.945646    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n4fr9" podStartSLOduration=3.072050987 podStartE2EDuration="21.94563473s" totalImagesPullingTime="18.873583743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.945201669 +0000 UTC m=+22.633066120" watchObservedRunningTime="2026-07-27 19:05:41.94563473 +0000 UTC m=+22.633499168"
Jul 27 19:05:41.980908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:41.980874    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m94nw" podStartSLOduration=3.036745802 podStartE2EDuration="21.980862451s" totalImagesPullingTime="18.944116649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.980294387 +0000 UTC m=+22.668158836" watchObservedRunningTime="2026-07-27 19:05:41.980862451 +0000 UTC m=+22.668726890"
Jul 27 19:05:42.001749 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.001714    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cflrf" podStartSLOduration=3.185053937 podStartE2EDuration="22.001704189s" totalImagesPullingTime="18.816650252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:42.001387061 +0000 UTC m=+22.689251500" watchObservedRunningTime="2026-07-27 19:05:42.001704189 +0000 UTC m=+22.689568627"
Jul 27 19:05:42.776709 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.776238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:42.776709 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:42.776386    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:42.776709 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.776442    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:42.776709 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:42.776549    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:42.914651 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.914621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"f98e1bdeb0f9e03ac7403c240eac1609944b987d35f41e7613e04c9a98c4c08c"}
Jul 27 19:05:42.914798 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.914708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"30588cf68f81d119391b2a42fd643518bb5576e6d007fd24a2d9c4b17b78b78a"}
Jul 27 19:05:42.914798 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.914759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"c35b03772e99e831a06f8379bc5da20aa5e772cf5f99e109d06061b6e32ed794"}
Jul 27 19:05:42.914879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.914801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"1223cdbb88f1e20506f6a3007b4b27935331dd862fae532fb89a53e2c9b62169"}
Jul 27 19:05:42.916268 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.916230    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-69d2k" event={"ID":"6d3ff9ab-6be4-4619-91b1-a035e7f1f030","Type":"ContainerStarted","Data":"96c48049834774339534ef891c87e675a983392019e818e64ed7502d46adb4cf"}
Jul 27 19:05:42.932318 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.932295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:42.932431 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.932098    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-69d2k" podStartSLOduration=4.069143402 podStartE2EDuration="22.932080105s" totalImagesPullingTime="18.862936703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:42.931805936 +0000 UTC m=+23.619670381" watchObservedRunningTime="2026-07-27 19:05:42.932080105 +0000 UTC m=+23.619944546"
Jul 27 19:05:42.932949 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:42.932931    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:43.182364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.182331    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:05:43.210775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.210754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:43.211222 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.211197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cflrf"
Jul 27 19:05:43.717460 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.717349    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:05:43.18235221Z","UUID":"f28243e3-a253-4520-b6c3-1ca42318390a","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:05:43.718853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.718833    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:05:43.718971 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.718862    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:05:43.775606 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.775581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:43.775731 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:43.775674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:43.920171 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:43.920006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj" event={"ID":"7eba6440-c8ef-4088-9aea-f34827909fb3","Type":"ContainerStarted","Data":"64fad91c2b96b8968d34cdaef9a553519024aa8889f6d50193158ae0b6ac5f36"}
Jul 27 19:05:44.775889 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:44.775821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:44.776032 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:44.775949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:44.776032 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:44.775984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:44.776157 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:44.776056    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:44.925865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:44.925833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"fc0cd53c1d35cff3aec06faa164075474fdde3cf45e5a20ce2239f57f8ab19b8"}
Jul 27 19:05:45.775778 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:45.775750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:45.775958 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:45.775870    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:46.776083 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.775870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:46.776666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.775897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:46.776666 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:46.776225    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:46.776666 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:46.776345    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:46.933400 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.933347    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" event={"ID":"ca5f6c87-2d1c-4d40-8260-1c3226970cce","Type":"ContainerStarted","Data":"25674f2659ef891d01b50475860cb57c361787c78f5cd3279e59cb08cb845fb8"}
Jul 27 19:05:46.933577 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.933565    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:46.935503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.935475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj" event={"ID":"7eba6440-c8ef-4088-9aea-f34827909fb3","Type":"ContainerStarted","Data":"01b4ad13c4fa2f55b76692c3bd12cfb76afc95468cdf30174a1af84b4a763610"}
Jul 27 19:05:46.937181 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.937160    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="c64316e882fd87730446813a5dd4260ff2fbc7abc7f88349ff3d556952b69646" exitCode=0
Jul 27 19:05:46.937326 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.937188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"c64316e882fd87730446813a5dd4260ff2fbc7abc7f88349ff3d556952b69646"}
Jul 27 19:05:46.948409 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.948393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:46.959504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.959470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv" podStartSLOduration=8.033442876 podStartE2EDuration="26.95945969s" totalImagesPullingTime="18.926016814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:46.958743384 +0000 UTC m=+27.646607824" watchObservedRunningTime="2026-07-27 19:05:46.95945969 +0000 UTC m=+27.647324134"
Jul 27 19:05:46.975659 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:46.975627    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9zj" podStartSLOduration=3.712002746 podStartE2EDuration="26.975615603s" totalImagesPullingTime="23.263612857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:46.975179433 +0000 UTC m=+27.663043872" watchObservedRunningTime="2026-07-27 19:05:46.975615603 +0000 UTC m=+27.663480042"
Jul 27 19:05:47.214474 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:47.214433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:47.776423 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:47.776396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:47.776783 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:47.776513    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:47.939991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:47.939819    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:47.956302 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:47.955949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:05:48.776050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.776021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:48.776189 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:48.776148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:48.776286 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.776200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:48.776343 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:48.776304    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:48.832688 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.832667    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dn6m2"]
Jul 27 19:05:48.833507 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.833487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lrvxl"]
Jul 27 19:05:48.833607 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.833586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:48.833700 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:48.833682    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:48.834066 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.834045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m8pqz"]
Jul 27 19:05:48.943612 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.943561    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="15160312e2ff5d0c212e3b38fa0f714104f834a2f4580963d180c2d9f8bbf660" exitCode=0
Jul 27 19:05:48.943702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.943631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"15160312e2ff5d0c212e3b38fa0f714104f834a2f4580963d180c2d9f8bbf660"}
Jul 27 19:05:48.943702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.943661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:48.943793 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:48.943753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:48.943896 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:48.943876    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:48.944006 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:48.943979    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:50.776164 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:50.776139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:50.776540 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:50.776236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:50.776540 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:50.776265    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:50.776540 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:50.776324    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:50.776540 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:50.776356    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:50.776540 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:50.776431    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:50.949849 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:50.949796    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="7b96e54808a05a58d5082119002c0fc5a510d8de3d3890fa5061deacfd33fb82" exitCode=0
Jul 27 19:05:50.949935 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:50.949848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"7b96e54808a05a58d5082119002c0fc5a510d8de3d3890fa5061deacfd33fb82"}
Jul 27 19:05:51.905573 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:51.905538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:51.993794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:51.993761    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:52.092616 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:52.092584    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:52.775546 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:52.775519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:52.775720 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:52.775563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:52.775720 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:52.775563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:52.775720 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:52.775634    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:52.775844 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:52.775755    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:52.775844 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:52.775831    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:53.510429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:53.510397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:53.510841 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:53.510457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:53.510841 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.510561    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:53.510841 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.510569    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:53.510841 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.510608    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs podName:af1f0669-214e-4d18-aad2-9e59212a85af nodeName:}" failed. No retries permitted until 2026-07-27 19:06:25.510595477 +0000 UTC m=+66.198459895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs") pod "network-metrics-daemon-m8pqz" (UID: "af1f0669-214e-4d18-aad2-9e59212a85af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:53.510841 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.510758    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret podName:22142470-fec9-41b3-99cb-44dee37382c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:25.510752279 +0000 UTC m=+66.198616696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret") pod "global-pull-secret-syncer-dn6m2" (UID: "22142470-fec9-41b3-99cb-44dee37382c6") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:53.611657 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:53.611576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:53.611792 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.611761    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:53.611792 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.611785    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:53.611893 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.611799    2560 projected.go:196] Error preparing data for projected volume kube-api-access-h7jks for pod openshift-network-diagnostics/network-check-target-lrvxl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:53.611893 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:53.611864    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks podName:d0de702e-01ed-473b-88d0-7ae79441795d nodeName:}" failed. No retries permitted until 2026-07-27 19:06:25.611845418 +0000 UTC m=+66.299709838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7jks" (UniqueName: "kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks") pod "network-check-target-lrvxl" (UID: "d0de702e-01ed-473b-88d0-7ae79441795d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:54.083917 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:54.083832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:54.184910 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:54.184856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:54.775598 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:54.775569    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:54.776047 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:54.775605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:54.776047 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:54.775663    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:54.776047 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:54.775676    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lrvxl" podUID="d0de702e-01ed-473b-88d0-7ae79441795d"
Jul 27 19:05:54.776047 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:54.775752    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m8pqz" podUID="af1f0669-214e-4d18-aad2-9e59212a85af"
Jul 27 19:05:54.776047 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:54.775860    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dn6m2" podUID="22142470-fec9-41b3-99cb-44dee37382c6"
Jul 27 19:05:55.138758 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.138737    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-57.ec2.internal" event="NodeReady"
Jul 27 19:05:55.138857 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.138826    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:05:55.184212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.184190    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rrhh6"]
Jul 27 19:05:55.202168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.202151    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gbf2r"]
Jul 27 19:05:55.202313 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.202298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.204430 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.204410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:05:55.204659 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.204644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:05:55.204759 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.204671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:05:55.224790 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.224768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6659b515-acde-4fa4-8c70-35ec725e6b8e-config-volume\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.224790 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.224788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.224899 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.224814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6659b515-acde-4fa4-8c70-35ec725e6b8e-tmp-dir\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.224899 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.224843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvpzt\" (UniqueName: \"kubernetes.io/projected/6659b515-acde-4fa4-8c70-35ec725e6b8e-kube-api-access-pvpzt\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.230302 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.230282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbf2r"]
Jul 27 19:05:55.230388 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.230313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrhh6"]
Jul 27 19:05:55.230436 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.230385    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.233581 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.233558    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:05:55.237771 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.237752    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:05:55.237884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.237868    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:05:55.238082 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.238066    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7dvk\""
Jul 27 19:05:55.325638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rrx\" (UniqueName: \"kubernetes.io/projected/c209a0ea-bc78-4084-a079-197ad2da5d8f-kube-api-access-k5rrx\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.325638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6659b515-acde-4fa4-8c70-35ec725e6b8e-config-volume\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.325638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.325796 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6659b515-acde-4fa4-8c70-35ec725e6b8e-tmp-dir\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.325796 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvpzt\" (UniqueName: \"kubernetes.io/projected/6659b515-acde-4fa4-8c70-35ec725e6b8e-kube-api-access-pvpzt\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.325796 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:55.325748    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:55.325796 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c209a0ea-bc78-4084-a079-197ad2da5d8f-cert\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.325796 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:55.325796    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls podName:6659b515-acde-4fa4-8c70-35ec725e6b8e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:55.82577979 +0000 UTC m=+36.513644210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls") pod "dns-default-rrhh6" (UID: "6659b515-acde-4fa4-8c70-35ec725e6b8e") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:55.326075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.325919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6659b515-acde-4fa4-8c70-35ec725e6b8e-tmp-dir\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.326201 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.326183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6659b515-acde-4fa4-8c70-35ec725e6b8e-config-volume\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.336309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.336290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvpzt\" (UniqueName: \"kubernetes.io/projected/6659b515-acde-4fa4-8c70-35ec725e6b8e-kube-api-access-pvpzt\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.427038 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.427014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rrx\" (UniqueName: \"kubernetes.io/projected/c209a0ea-bc78-4084-a079-197ad2da5d8f-kube-api-access-k5rrx\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.427135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.427087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c209a0ea-bc78-4084-a079-197ad2da5d8f-cert\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.429879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.429858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c209a0ea-bc78-4084-a079-197ad2da5d8f-cert\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.434663 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.434642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rrx\" (UniqueName: \"kubernetes.io/projected/c209a0ea-bc78-4084-a079-197ad2da5d8f-kube-api-access-k5rrx\") pod \"ingress-canary-gbf2r\" (UID: \"c209a0ea-bc78-4084-a079-197ad2da5d8f\") " pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.537984 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.537961    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbf2r"
Jul 27 19:05:55.708527 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.708495    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbf2r"]
Jul 27 19:05:55.711741 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:55.711712    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc209a0ea_bc78_4084_a079_197ad2da5d8f.slice/crio-9ff2d252842a7d05d82c43c25c2e324674276254ac153502de48c69ad5976000 WatchSource:0}: Error finding container 9ff2d252842a7d05d82c43c25c2e324674276254ac153502de48c69ad5976000: Status 404 returned error can't find the container with id 9ff2d252842a7d05d82c43c25c2e324674276254ac153502de48c69ad5976000
Jul 27 19:05:55.830301 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.830154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:55.830837 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:55.830306    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:55.830837 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:55.830364    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls podName:6659b515-acde-4fa4-8c70-35ec725e6b8e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.830349847 +0000 UTC m=+37.518214265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls") pod "dns-default-rrhh6" (UID: "6659b515-acde-4fa4-8c70-35ec725e6b8e") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:55.964713 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.964661    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="a9fbe6d873bf896248192abb8576e03c569b760976e369747feec5307acab9ef" exitCode=0
Jul 27 19:05:55.964798 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.964739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"a9fbe6d873bf896248192abb8576e03c569b760976e369747feec5307acab9ef"}
Jul 27 19:05:55.965874 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:55.965848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbf2r" event={"ID":"c209a0ea-bc78-4084-a079-197ad2da5d8f","Type":"ContainerStarted","Data":"9ff2d252842a7d05d82c43c25c2e324674276254ac153502de48c69ad5976000"}
Jul 27 19:05:56.776542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.776456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:05:56.776542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.776499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:05:56.776542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.776468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:05:56.779168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.779144    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:05:56.780046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.780016    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:05:56.780161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.780021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:05:56.780161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.780117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:05:56.780161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.780156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:05:56.780340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.780097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:05:56.836819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.836793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:56.837135 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:56.836973    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:56.837135 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:56.837040    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls podName:6659b515-acde-4fa4-8c70-35ec725e6b8e nodeName:}" failed. No retries permitted until 2026-07-27 19:05:58.837020173 +0000 UTC m=+39.524884595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls") pod "dns-default-rrhh6" (UID: "6659b515-acde-4fa4-8c70-35ec725e6b8e") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:56.972184 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.972158    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c693612-fe82-440c-9a86-ebe0efb5520e" containerID="e481ec70cec89f783a5f331b909661ae9bd62599da84e53d7fffefe17b576304" exitCode=0
Jul 27 19:05:56.972333 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:56.972233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerDied","Data":"e481ec70cec89f783a5f331b909661ae9bd62599da84e53d7fffefe17b576304"}
Jul 27 19:05:57.858910 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:57.858876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:57.908495 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:57.908460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:57.977166 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:57.977139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mshqx" event={"ID":"8c693612-fe82-440c-9a86-ebe0efb5520e","Type":"ContainerStarted","Data":"92c5c01b2dd1db1c5ce5d7056a90d6561fe52b66c03137b245b8b3c7ad6e34f3"}
Jul 27 19:05:58.001311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.001268    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mshqx" podStartSLOduration=8.047398704 podStartE2EDuration="38.001234429s" totalImagesPullingTime="29.953835725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:58.001089736 +0000 UTC m=+38.688954198" watchObservedRunningTime="2026-07-27 19:05:58.001234429 +0000 UTC m=+38.689098869"
Jul 27 19:05:58.377836 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.377806    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:58.425873 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.425848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:58.851073 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.851044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:05:58.851201 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:58.851183    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:58.851264 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:58.851242    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls podName:6659b515-acde-4fa4-8c70-35ec725e6b8e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:02.851227873 +0000 UTC m=+43.539092291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls") pod "dns-default-rrhh6" (UID: "6659b515-acde-4fa4-8c70-35ec725e6b8e") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:58.895489 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.895466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:58.980693 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.980668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbf2r" event={"ID":"c209a0ea-bc78-4084-a079-197ad2da5d8f","Type":"ContainerStarted","Data":"8f4cbcabeee5261c429bfc41e0cc308a4134e59570b864647d485f689f8f1046"}
Jul 27 19:05:58.992604 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.992574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:58.995712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:58.995679    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gbf2r" podStartSLOduration=1.779416168 podStartE2EDuration="3.99566753s" totalImagesPullingTime="2.216251362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:58.995091926 +0000 UTC m=+39.682956375" watchObservedRunningTime="2026-07-27 19:05:58.99566753 +0000 UTC m=+39.683531969"
Jul 27 19:05:59.056531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.056510    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.136807 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.136781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.236139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.236120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.289713 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.289692    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4n77p"]
Jul 27 19:05:59.291715 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.291688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.294194 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.294177    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:05:59.294294 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.294284    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\""
Jul 27 19:05:59.294407 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.294393    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:05:59.294478 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.294465    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:05:59.294545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.294531    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:05:59.304659 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.304634    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4n77p"]
Jul 27 19:05:59.323673 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.323648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.354705 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.354679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-crio-socket\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.354802 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.354743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.354802 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.354781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.354907 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.354820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htv2t\" (UniqueName: \"kubernetes.io/projected/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-api-access-htv2t\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.354907 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.354885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-data-volume\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.385804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.385776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.455666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htv2t\" (UniqueName: \"kubernetes.io/projected/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-api-access-htv2t\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455782 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-data-volume\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455782 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-crio-socket\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455782 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.455731    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.455884 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.455810    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:05:59.955790324 +0000 UTC m=+40.643654764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.455884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-crio-socket\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455957 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.455881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.455990 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.455957    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.456025 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.456009    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:05:59.955997127 +0000 UTC m=+40.643861544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.456025 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.456005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-data-volume\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.465340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.465324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htv2t\" (UniqueName: \"kubernetes.io/projected/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-api-access-htv2t\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.560990 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.560960    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"]
Jul 27 19:05:59.562619 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.562606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"
Jul 27 19:05:59.564762 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.564743    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:59.564922 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.564907    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c7hh5\""
Jul 27 19:05:59.564922 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.564917    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 19:05:59.568002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.567971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.573221 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.573202    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"]
Jul 27 19:05:59.635409 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.635382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:05:59.657451 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.657423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmmhk\" (UniqueName: \"kubernetes.io/projected/122657b5-9762-45cd-bbdf-2269bb3a7f93-kube-api-access-cmmhk\") pod \"migrator-6865c9967-5l5dm\" (UID: \"122657b5-9762-45cd-bbdf-2269bb3a7f93\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"
Jul 27 19:05:59.757654 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.757613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmmhk\" (UniqueName: \"kubernetes.io/projected/122657b5-9762-45cd-bbdf-2269bb3a7f93-kube-api-access-cmmhk\") pod \"migrator-6865c9967-5l5dm\" (UID: \"122657b5-9762-45cd-bbdf-2269bb3a7f93\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"
Jul 27 19:05:59.766304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.766282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmmhk\" (UniqueName: \"kubernetes.io/projected/122657b5-9762-45cd-bbdf-2269bb3a7f93-kube-api-access-cmmhk\") pod \"migrator-6865c9967-5l5dm\" (UID: \"122657b5-9762-45cd-bbdf-2269bb3a7f93\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"
Jul 27 19:05:59.870391 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.870374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"
Jul 27 19:05:59.958972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.958946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.959273 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.958984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:05:59.959273 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.959079    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.959273 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.959117    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.959273 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.959130    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.959117361 +0000 UTC m=+41.646981779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.959273 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:05:59.959195    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.959175686 +0000 UTC m=+41.647040111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.982974 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:05:59.982944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm"]
Jul 27 19:05:59.985766 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:05:59.985747    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122657b5_9762_45cd_bbdf_2269bb3a7f93.slice/crio-cb2a8443a5ff6cdb22a13f5729e2196492ae333af5c5cb7a648415242937318e WatchSource:0}: Error finding container cb2a8443a5ff6cdb22a13f5729e2196492ae333af5c5cb7a648415242937318e: Status 404 returned error can't find the container with id cb2a8443a5ff6cdb22a13f5729e2196492ae333af5c5cb7a648415242937318e
Jul 27 19:06:00.074992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:00.074936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:00.135222 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:00.135195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:00.965695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:00.965661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:00.965695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:00.965701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:00.966150 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:00.965791    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:00.966150 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:00.965840    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.966150 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:00.965856    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:02.965839911 +0000 UTC m=+43.653704333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:00.966150 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:00.965901    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:02.965883345 +0000 UTC m=+43.653747767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.987142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:00.987108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm" event={"ID":"122657b5-9762-45cd-bbdf-2269bb3a7f93","Type":"ContainerStarted","Data":"cb2a8443a5ff6cdb22a13f5729e2196492ae333af5c5cb7a648415242937318e"}
Jul 27 19:06:01.208023 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.208002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:01.308427 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.308404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:01.476218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.476175    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n4fr9_a7c2042c-583a-4024-8930-e53191447a71/dns-node-resolver/0.log"
Jul 27 19:06:01.672681 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.672657    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-q9nzf"]
Jul 27 19:06:01.692330 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.692310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-q9nzf"]
Jul 27 19:06:01.692397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.692388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.694758 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.694740    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 19:06:01.694863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.694767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jdkrw\""
Jul 27 19:06:01.694863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.694797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 19:06:01.694863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.694829    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 19:06:01.695708 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.695692    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 19:06:01.710445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.710425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:01.770643 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.770604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-cabundle\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.770643 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.770627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjnk7\" (UniqueName: \"kubernetes.io/projected/66447c6a-5775-46e0-9bbe-5ceff1e178d6-kube-api-access-cjnk7\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.770743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.770661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-key\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.871634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.871613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-key\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.871724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.871710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-cabundle\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.871759 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.871737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjnk7\" (UniqueName: \"kubernetes.io/projected/66447c6a-5775-46e0-9bbe-5ceff1e178d6-kube-api-access-cjnk7\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.872304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.872279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-cabundle\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.873850 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.873835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66447c6a-5775-46e0-9bbe-5ceff1e178d6-signing-key\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.879337 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.879314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjnk7\" (UniqueName: \"kubernetes.io/projected/66447c6a-5775-46e0-9bbe-5ceff1e178d6-kube-api-access-cjnk7\") pod \"service-ca-658d7b7c78-q9nzf\" (UID: \"66447c6a-5775-46e0-9bbe-5ceff1e178d6\") " pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:01.990287 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.990243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm" event={"ID":"122657b5-9762-45cd-bbdf-2269bb3a7f93","Type":"ContainerStarted","Data":"04dd940da883e67661476cd3c6b4472e9432f359de995964b4fd22e4bdde7143"}
Jul 27 19:06:01.990532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:01.990306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm" event={"ID":"122657b5-9762-45cd-bbdf-2269bb3a7f93","Type":"ContainerStarted","Data":"3ae1c9631acba4638745afce785e4e7072fd103f51afb17ab3e20d8975e937bf"}
Jul 27 19:06:02.000437 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.000419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf"
Jul 27 19:06:02.005229 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.005090    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5l5dm" podStartSLOduration=1.832140086 podStartE2EDuration="3.005076297s" totalImagesPullingTime="1.172936211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:02.004787749 +0000 UTC m=+42.692652188" watchObservedRunningTime="2026-07-27 19:06:02.005076297 +0000 UTC m=+42.692940736"
Jul 27 19:06:02.074439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.074405    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:02.076023 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.075735    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzcd5_0e6fb64f-8445-4e89-a2a3-c26659b8400d/node-ca/0.log"
Jul 27 19:06:02.128995 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.128973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:02.141042 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.141021    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-q9nzf"]
Jul 27 19:06:02.145399 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:02.145380    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66447c6a_5775_46e0_9bbe_5ceff1e178d6.slice/crio-312ebdd61af782c17ad178328e529692a8e63a2cc9a584ae34dc2296e5fc2bc0 WatchSource:0}: Error finding container 312ebdd61af782c17ad178328e529692a8e63a2cc9a584ae34dc2296e5fc2bc0: Status 404 returned error can't find the container with id 312ebdd61af782c17ad178328e529692a8e63a2cc9a584ae34dc2296e5fc2bc0
Jul 27 19:06:02.568503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.568484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:02.879588 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.877171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gbf2r_c209a0ea-bc78-4084-a079-197ad2da5d8f/serve-healthcheck-canary/0.log"
Jul 27 19:06:02.880043 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.880019    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:06:02.880318 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.880297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:02.880401 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.880352    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls podName:6659b515-acde-4fa4-8c70-35ec725e6b8e nodeName:}" failed. No retries permitted until 2026-07-27 19:06:10.880335827 +0000 UTC m=+51.568200244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls") pod "dns-default-rrhh6" (UID: "6659b515-acde-4fa4-8c70-35ec725e6b8e") : secret "dns-default-metrics-tls" not found
Jul 27 19:06:02.980806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.980782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:02.980916 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.980852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:02.980969 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.980922    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:02.980969 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.980940    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:02.981036 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.980989    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:06.980972134 +0000 UTC m=+47.668836553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:02.981036 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:02.981008    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:06.980999272 +0000 UTC m=+47.668863708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:02.994116 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:02.994094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf" event={"ID":"66447c6a-5775-46e0-9bbe-5ceff1e178d6","Type":"ContainerStarted","Data":"312ebdd61af782c17ad178328e529692a8e63a2cc9a584ae34dc2296e5fc2bc0"}
Jul 27 19:06:04.549235 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:04.549209    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:04.882734 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:04.882697    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:05.000666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:05.000640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf" event={"ID":"66447c6a-5775-46e0-9bbe-5ceff1e178d6","Type":"ContainerStarted","Data":"dd6715c6986775fc9a6505a73edabe729dfa025473a9069b18b798f93d168768"}
Jul 27 19:06:05.021803 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:05.021764    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-q9nzf" podStartSLOduration=1.670357996 podStartE2EDuration="4.021752609s" totalImagesPullingTime="2.351394613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:05.021277952 +0000 UTC m=+45.709142393" watchObservedRunningTime="2026-07-27 19:06:05.021752609 +0000 UTC m=+45.709617048"
Jul 27 19:06:05.983208 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:05.983179    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:06.486717 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:06.486687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:06.538155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:06.538118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:06.735583 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:06.735559    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:06.791154 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:06.791074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:06.893844 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:06.893818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:07.007784 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:07.007762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:07.008144 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:07.007793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:07.008144 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:07.007922    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.008144 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:06:07.008002    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls podName:93f8f292-fb8f-4e3d-8e85-f86b3fe70eae nodeName:}" failed. No retries permitted until 2026-07-27 19:06:15.007983101 +0000 UTC m=+55.695847520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4n77p" (UID: "93f8f292-fb8f-4e3d-8e85-f86b3fe70eae") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.008330 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:07.008238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:07.285805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:07.285782    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:07.873784 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:07.873759    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:08.274911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:08.274848    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:08.475743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:08.475709    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:08.878834 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:08.878808    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:09.463159 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:09.463141    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:09.563261 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:09.563225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:09.678481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:09.678457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:09.785281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:09.785211    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:09.886517 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:09.886481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:10.277823 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:10.277804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:10.473999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:10.473977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:10.525256 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:10.525233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:10.935072 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:10.935053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:10.937207 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:10.937190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6659b515-acde-4fa4-8c70-35ec725e6b8e-metrics-tls\") pod \"dns-default-rrhh6\" (UID: \"6659b515-acde-4fa4-8c70-35ec725e6b8e\") " pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:11.075676 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.075634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:11.111149 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.111129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:11.247911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.247885    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rrhh6"]
Jul 27 19:06:11.250933 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:11.250909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6659b515_acde_4fa4_8c70_35ec725e6b8e.slice/crio-6b2877c5408d0f41c3c1ebf0a8a8dd1b1b51f18ef9bb18658db7addce9755576 WatchSource:0}: Error finding container 6b2877c5408d0f41c3c1ebf0a8a8dd1b1b51f18ef9bb18658db7addce9755576: Status 404 returned error can't find the container with id 6b2877c5408d0f41c3c1ebf0a8a8dd1b1b51f18ef9bb18658db7addce9755576
Jul 27 19:06:11.682442 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.682397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:11.882226 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.882202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:11.983556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:11.983452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:12.017486 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:12.017453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrhh6" event={"ID":"6659b515-acde-4fa4-8c70-35ec725e6b8e","Type":"ContainerStarted","Data":"6b2877c5408d0f41c3c1ebf0a8a8dd1b1b51f18ef9bb18658db7addce9755576"}
Jul 27 19:06:12.095286 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:12.093660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:12.249175 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:12.249110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:12.483576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:12.483555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:12.877398 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:12.877353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:13.678746 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:13.678711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:13.877117 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:13.877093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:14.024652 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:14.024627    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrhh6" event={"ID":"6659b515-acde-4fa4-8c70-35ec725e6b8e","Type":"ContainerStarted","Data":"3848cb2346f18ebc4879af17b9cd758bcdc71ac2c1e268b2cddd5a0e49c7c53e"}
Jul 27 19:06:14.025013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:14.024677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rrhh6" event={"ID":"6659b515-acde-4fa4-8c70-35ec725e6b8e","Type":"ContainerStarted","Data":"2687bff9e9e29bc7a6f4d027fc157b58925af77062669f607178f4324bc187ae"}
Jul 27 19:06:14.025013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:14.024763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:14.282654 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:14.282583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:14.474867 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:14.474844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:15.063660 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.063639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:15.065921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.065896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93f8f292-fb8f-4e3d-8e85-f86b3fe70eae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4n77p\" (UID: \"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae\") " pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:15.077921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.077895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:15.200159 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.200134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4n77p"
Jul 27 19:06:15.329290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.329176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rrhh6" podStartSLOduration=18.019336117 podStartE2EDuration="20.32915298s" totalImagesPullingTime="2.309816863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:14.042242011 +0000 UTC m=+54.730106449" watchObservedRunningTime="2026-07-27 19:06:15.32915298 +0000 UTC m=+56.017017423"
Jul 27 19:06:15.329638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.329619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4n77p"]
Jul 27 19:06:15.332763 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:15.332738    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f8f292_fb8f_4e3d_8e85_f86b3fe70eae.slice/crio-2f6dad3f56669d1e68d23268958c08208f3a01c776b32086c1dc83462657996c WatchSource:0}: Error finding container 2f6dad3f56669d1e68d23268958c08208f3a01c776b32086c1dc83462657996c: Status 404 returned error can't find the container with id 2f6dad3f56669d1e68d23268958c08208f3a01c776b32086c1dc83462657996c
Jul 27 19:06:15.678123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.678083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:15.875972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:15.875951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:16.031626 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:16.031566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4n77p" event={"ID":"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae","Type":"ContainerStarted","Data":"2f6dad3f56669d1e68d23268958c08208f3a01c776b32086c1dc83462657996c"}
Jul 27 19:06:16.079874 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:16.079844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:16.274889 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:16.274844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:16.679998 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:16.679963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:19.957000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:19.956973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pbvtv"
Jul 27 19:06:20.794484 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.794459    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"]
Jul 27 19:06:20.796043 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.796028    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"]
Jul 27 19:06:20.796159 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.796143    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:20.797677 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.797660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.798691 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.798676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zbmhz\""
Jul 27 19:06:20.799053 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.799037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:06:20.799309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.799277    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 19:06:20.799309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.799291    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:06:20.799467 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.799323    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:06:20.802521 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.802501    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 19:06:20.802605 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.802594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 19:06:20.802766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.802751    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 19:06:20.802816 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.802754    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 19:06:20.823045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.823027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"]
Jul 27 19:06:20.823982 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.823966    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"]
Jul 27 19:06:20.835203 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.835185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:20.903942 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.903924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.904046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.903948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.904046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.903974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb67k\" (UniqueName: \"kubernetes.io/projected/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-kube-api-access-vb67k\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:20.904046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.903993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.904046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.904010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.904270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.904101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/55d0d51e-5ac1-45f4-8732-9271ca250ebd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.904270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.904156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:20.904270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.904189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvm5b\" (UniqueName: \"kubernetes.io/projected/55d0d51e-5ac1-45f4-8732-9271ca250ebd-kube-api-access-pvm5b\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:20.966769 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:20.966750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:21.005306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvm5b\" (UniqueName: \"kubernetes.io/projected/55d0d51e-5ac1-45f4-8732-9271ca250ebd-kube-api-access-pvm5b\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005401 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005401 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb67k\" (UniqueName: \"kubernetes.io/projected/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-kube-api-access-vb67k\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:21.005564 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005564 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005656 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/55d0d51e-5ac1-45f4-8732-9271ca250ebd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.005656 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.005620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:21.006533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.006508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/55d0d51e-5ac1-45f4-8732-9271ca250ebd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.008076 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.008058    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.008152 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.008077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.008193 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.008157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.008226 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.008207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/55d0d51e-5ac1-45f4-8732-9271ca250ebd-ca\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.008445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.008429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:21.016694 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.016676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvm5b\" (UniqueName: \"kubernetes.io/projected/55d0d51e-5ac1-45f4-8732-9271ca250ebd-kube-api-access-pvm5b\") pod \"cluster-proxy-proxy-agent-97f998bfb-kzqfv\" (UID: \"55d0d51e-5ac1-45f4-8732-9271ca250ebd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.016769 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.016679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb67k\" (UniqueName: \"kubernetes.io/projected/74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f-kube-api-access-vb67k\") pod \"managed-serviceaccount-addon-agent-d7878bb7d-8999p\" (UID: \"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:21.046671 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.046599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:21.050550 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.050524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4n77p" event={"ID":"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae","Type":"ContainerStarted","Data":"6c6160ca9ae5d9d0ef5ed858cd90b5b9447b5a0f10c1903733b497e331c3d64d"}
Jul 27 19:06:21.114354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.114322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"
Jul 27 19:06:21.119609 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.119595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"
Jul 27 19:06:21.239953 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.239917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p"]
Jul 27 19:06:21.242477 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:21.242450    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74725854_ae58_4cbd_a8c5_f2d4cd8ebd1f.slice/crio-82c999c4df94ff59410cae27e62b099b7f9b072540435ed2fa89ad6a9ed74a34 WatchSource:0}: Error finding container 82c999c4df94ff59410cae27e62b099b7f9b072540435ed2fa89ad6a9ed74a34: Status 404 returned error can't find the container with id 82c999c4df94ff59410cae27e62b099b7f9b072540435ed2fa89ad6a9ed74a34
Jul 27 19:06:21.256049 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.256020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv"]
Jul 27 19:06:21.259069 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:21.259040    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55d0d51e_5ac1_45f4_8732_9271ca250ebd.slice/crio-a0263ec4b5d6818a3d968c2a2bd35612bb89b03bac2fdec08fecade8c552db1a WatchSource:0}: Error finding container a0263ec4b5d6818a3d968c2a2bd35612bb89b03bac2fdec08fecade8c552db1a: Status 404 returned error can't find the container with id a0263ec4b5d6818a3d968c2a2bd35612bb89b03bac2fdec08fecade8c552db1a
Jul 27 19:06:21.736587 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.736552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:21.831612 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:21.831583    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:22.054971 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.054870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv" event={"ID":"55d0d51e-5ac1-45f4-8732-9271ca250ebd","Type":"ContainerStarted","Data":"a0263ec4b5d6818a3d968c2a2bd35612bb89b03bac2fdec08fecade8c552db1a"}
Jul 27 19:06:22.056046 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.056007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p" event={"ID":"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f","Type":"ContainerStarted","Data":"82c999c4df94ff59410cae27e62b099b7f9b072540435ed2fa89ad6a9ed74a34"}
Jul 27 19:06:22.150234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.150191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:22.207353 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.207320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:22.314898 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.314823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:22.515331 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.515293    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:22.613301 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:22.613205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:23.154269 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:23.154221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:23.209946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:23.209918    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:23.727396 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:23.727301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:23.920198 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:23.920170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:24.029773 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:24.029682    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rrhh6"
Jul 27 19:06:24.401274 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:24.401234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:24.500990 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:24.500952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:25.069746 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.069708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4n77p" event={"ID":"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae","Type":"ContainerStarted","Data":"b6dfee637727decc669731fd0f62052094d3afe70d65faa149c1d0108a8ff766"}
Jul 27 19:06:25.339488 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.339394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:25.440051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.439986    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:25.540327 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.540297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:06:25.540481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.540351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:06:25.543306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.543243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:06:25.543863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.543841    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:06:25.554691 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.554656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1f0669-214e-4d18-aad2-9e59212a85af-metrics-certs\") pod \"network-metrics-daemon-m8pqz\" (UID: \"af1f0669-214e-4d18-aad2-9e59212a85af\") " pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:06:25.555079 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.555059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22142470-fec9-41b3-99cb-44dee37382c6-original-pull-secret\") pod \"global-pull-secret-syncer-dn6m2\" (UID: \"22142470-fec9-41b3-99cb-44dee37382c6\") " pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:06:25.594372 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.594302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dn6m2"
Jul 27 19:06:25.602475 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.602454    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:06:25.610538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.610519    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m8pqz"
Jul 27 19:06:25.641425 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.641372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:06:25.644241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.644096    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:06:25.654509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.654487    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:06:25.665927 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.665885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jks\" (UniqueName: \"kubernetes.io/projected/d0de702e-01ed-473b-88d0-7ae79441795d-kube-api-access-h7jks\") pod \"network-check-target-lrvxl\" (UID: \"d0de702e-01ed-473b-88d0-7ae79441795d\") " pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:06:25.890190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.890165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:06:25.899419 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:25.899175    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:06:26.006907 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.006725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dn6m2"]
Jul 27 19:06:26.010066 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:26.010039    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22142470_fec9_41b3_99cb_44dee37382c6.slice/crio-5b5fdf7517e9d740aca8cff8ec40e87d2b936c10fe7fd5095a59ddc3fca995cb WatchSource:0}: Error finding container 5b5fdf7517e9d740aca8cff8ec40e87d2b936c10fe7fd5095a59ddc3fca995cb: Status 404 returned error can't find the container with id 5b5fdf7517e9d740aca8cff8ec40e87d2b936c10fe7fd5095a59ddc3fca995cb
Jul 27 19:06:26.033680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.033654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m8pqz"]
Jul 27 19:06:26.038036 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:26.038014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1f0669_214e_4d18_aad2_9e59212a85af.slice/crio-37cd81acaf120520c848080b756e352932a081d36d00dbd49868d9b400d00f1f WatchSource:0}: Error finding container 37cd81acaf120520c848080b756e352932a081d36d00dbd49868d9b400d00f1f: Status 404 returned error can't find the container with id 37cd81acaf120520c848080b756e352932a081d36d00dbd49868d9b400d00f1f
Jul 27 19:06:26.061227 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.061204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lrvxl"]
Jul 27 19:06:26.064022 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:26.064001    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0de702e_01ed_473b_88d0_7ae79441795d.slice/crio-bafa6c9ef3d7a7796c7f61eed90d9ca9c4b9c6812660e5fe52fc016e5d9ade63 WatchSource:0}: Error finding container bafa6c9ef3d7a7796c7f61eed90d9ca9c4b9c6812660e5fe52fc016e5d9ade63: Status 404 returned error can't find the container with id bafa6c9ef3d7a7796c7f61eed90d9ca9c4b9c6812660e5fe52fc016e5d9ade63
Jul 27 19:06:26.074283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.074243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8pqz" event={"ID":"af1f0669-214e-4d18-aad2-9e59212a85af","Type":"ContainerStarted","Data":"37cd81acaf120520c848080b756e352932a081d36d00dbd49868d9b400d00f1f"}
Jul 27 19:06:26.075516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.075489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lrvxl" event={"ID":"d0de702e-01ed-473b-88d0-7ae79441795d","Type":"ContainerStarted","Data":"bafa6c9ef3d7a7796c7f61eed90d9ca9c4b9c6812660e5fe52fc016e5d9ade63"}
Jul 27 19:06:26.076550 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:26.076527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dn6m2" event={"ID":"22142470-fec9-41b3-99cb-44dee37382c6","Type":"ContainerStarted","Data":"5b5fdf7517e9d740aca8cff8ec40e87d2b936c10fe7fd5095a59ddc3fca995cb"}
Jul 27 19:06:28.087464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:28.087376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4n77p" event={"ID":"93f8f292-fb8f-4e3d-8e85-f86b3fe70eae","Type":"ContainerStarted","Data":"490c98ab649ad5580bc790a56a1d86f0d8a7dca7c537ac11c626ca4f7c0f2f78"}
Jul 27 19:06:28.105668 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:28.105621    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4n77p" podStartSLOduration=16.747073802 podStartE2EDuration="29.105606948s" totalImagesPullingTime="12.358533146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:28.103414285 +0000 UTC m=+68.791278724" watchObservedRunningTime="2026-07-27 19:06:28.105606948 +0000 UTC m=+68.793471377"
Jul 27 19:06:29.095050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:29.095005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8pqz" event={"ID":"af1f0669-214e-4d18-aad2-9e59212a85af","Type":"ContainerStarted","Data":"9264c6b212bb2274f2a99bf97b1fccd8883590a8667fd60291847c339cf89b5b"}
Jul 27 19:06:29.717995 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:29.717948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:29.822489 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:29.822450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:29.913549 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:29.913504    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:30.100637 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.100565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m8pqz" event={"ID":"af1f0669-214e-4d18-aad2-9e59212a85af","Type":"ContainerStarted","Data":"9463a0824dbec3d2e9a47fc9dfb1433b5894e7312bcd2330f5a1e75ab560f6a0"}
Jul 27 19:06:30.117814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.117762    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m8pqz" podStartSLOduration=67.280963426 podStartE2EDuration="1m10.117741589s" totalImagesPullingTime="2.836778163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.116892897 +0000 UTC m=+70.804757336" watchObservedRunningTime="2026-07-27 19:06:30.117741589 +0000 UTC m=+70.805606028"
Jul 27 19:06:30.151590 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.151561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:30.253086 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.253054    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:30.337395 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.337354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:30.390415 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.390360    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:30.883470 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:30.883430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:31.303400 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:31.303325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:31.708902 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:31.708821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:31.796740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:31.796708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:33.068424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.068392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:33.113206 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.113183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lrvxl" event={"ID":"d0de702e-01ed-473b-88d0-7ae79441795d","Type":"ContainerStarted","Data":"c33bc0bd7788846e16db7d2e6bdb40bd58fdd53df8537186eb5912fbbcf50e78"}
Jul 27 19:06:33.113355 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.113279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:06:33.114726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.114705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dn6m2" event={"ID":"22142470-fec9-41b3-99cb-44dee37382c6","Type":"ContainerStarted","Data":"8a0340405557accc28902d42d14d9411aaa8e1ba0f1fbe5f2a1b90e5cfd67bbd"}
Jul 27 19:06:33.130971 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.130932    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lrvxl" podStartSLOduration=67.126163584 podStartE2EDuration="1m13.130920011s" totalImagesPullingTime="6.004756427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:33.128153118 +0000 UTC m=+73.816017557" watchObservedRunningTime="2026-07-27 19:06:33.130920011 +0000 UTC m=+73.818784710"
Jul 27 19:06:33.143647 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.143548    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dn6m2" podStartSLOduration=67.081321205 podStartE2EDuration="1m13.143532475s" totalImagesPullingTime="6.06221127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:33.142869308 +0000 UTC m=+73.830733756" watchObservedRunningTime="2026-07-27 19:06:33.143532475 +0000 UTC m=+73.831396915"
Jul 27 19:06:33.147085 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.147056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:33.205584 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:33.205555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:35.737710 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:35.737678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:35.790059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:35.790022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:37.742256 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:37.742223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:37.844812 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:37.844790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:38.044331 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:38.044231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:38.114279 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:38.114241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:38.460975 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:38.460955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:40.687118 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:40.687087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:41.556222 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:41.556189    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:41.607316 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:41.607286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.162496 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.162466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.253011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.252978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.351830 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.351792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.423523 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.423460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.467513 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.467493    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tltpb"]
Jul 27 19:06:42.470984 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.470966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.473311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.473289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:06:42.473455 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.473438    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:06:42.473516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.473440    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:06:42.474034 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.473595    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:06:42.474034 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.473840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g68sl\""
Jul 27 19:06:42.474280 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.474263    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:06:42.474702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.474684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:06:42.516964 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.516936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.550875 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.550857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-sys\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.550979 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.550893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.550979 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.550919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-tls\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.550988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwfv\" (UniqueName: \"kubernetes.io/projected/1f6d77fe-c373-4716-b18b-33b87a355122-kube-api-access-5bwfv\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.551024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-textfile\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.551048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-metrics-client-ca\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.551080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-wtmp\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.551136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-root\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.551241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.551239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-accelerators-collector-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.651791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-accelerators-collector-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.651897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-sys\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.651897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-sys\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-tls\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwfv\" (UniqueName: \"kubernetes.io/projected/1f6d77fe-c373-4716-b18b-33b87a355122-kube-api-access-5bwfv\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-textfile\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.651993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-metrics-client-ca\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-wtmp\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-root\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652396 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-root\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652479 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-accelerators-collector-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652479 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-wtmp\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652486    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-textfile\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.652555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.652523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f6d77fe-c373-4716-b18b-33b87a355122-metrics-client-ca\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.654419 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.654395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-tls\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.654707 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.654688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f6d77fe-c373-4716-b18b-33b87a355122-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.660632 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.660611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwfv\" (UniqueName: \"kubernetes.io/projected/1f6d77fe-c373-4716-b18b-33b87a355122-kube-api-access-5bwfv\") pod \"node-exporter-tltpb\" (UID: \"1f6d77fe-c373-4716-b18b-33b87a355122\") " pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.715056 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.714749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.781096 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.781076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tltpb"
Jul 27 19:06:42.791071 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:06:42.791049    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6d77fe_c373_4716_b18b_33b87a355122.slice/crio-67df6ed8af81fd39216e9bad8baf433eb64fe7688ef050fb14ac7f7c2b5c4505 WatchSource:0}: Error finding container 67df6ed8af81fd39216e9bad8baf433eb64fe7688ef050fb14ac7f7c2b5c4505: Status 404 returned error can't find the container with id 67df6ed8af81fd39216e9bad8baf433eb64fe7688ef050fb14ac7f7c2b5c4505
Jul 27 19:06:42.816509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.816485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:42.893496 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:42.893461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:43.010948 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.010888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:43.103235 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.103214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:43.142930 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.142913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tltpb" event={"ID":"1f6d77fe-c373-4716-b18b-33b87a355122","Type":"ContainerStarted","Data":"67df6ed8af81fd39216e9bad8baf433eb64fe7688ef050fb14ac7f7c2b5c4505"}
Jul 27 19:06:43.416453 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.416430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:43.554372 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.554341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:43.618461 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:43.618421    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:44.149739 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:44.149708    2560 generic.go:356] "Generic (PLEG): container finished" podID="1f6d77fe-c373-4716-b18b-33b87a355122" containerID="bdf5b2391cf7230807d6fee782a78cd34f71883a17a87807d890062e19e4ddd6" exitCode=0
Jul 27 19:06:44.149836 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:44.149753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tltpb" event={"ID":"1f6d77fe-c373-4716-b18b-33b87a355122","Type":"ContainerDied","Data":"bdf5b2391cf7230807d6fee782a78cd34f71883a17a87807d890062e19e4ddd6"}
Jul 27 19:06:45.154998 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.154960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tltpb" event={"ID":"1f6d77fe-c373-4716-b18b-33b87a355122","Type":"ContainerStarted","Data":"1e7132da3a19ce50acb36625ccf6aa3c407d18aba3f3e167bce569747ce0b84c"}
Jul 27 19:06:45.155408 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.155059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tltpb" event={"ID":"1f6d77fe-c373-4716-b18b-33b87a355122","Type":"ContainerStarted","Data":"9f330599aac6528ea879975841f9cf2cc89c5522dd05cad8823091c3ec09ac8b"}
Jul 27 19:06:45.156414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.156387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p" event={"ID":"74725854-ae58-4cbd-a8c5-f2d4cd8ebd1f","Type":"ContainerStarted","Data":"ded451bbd722d778242431102c4299246e3d653dbd6c33b8f7824ab4d6d10603"}
Jul 27 19:06:45.173440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.173400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tltpb" podStartSLOduration=2.131950715 podStartE2EDuration="3.173387533s" totalImagesPullingTime="974.500422ms" totalInitContainerRuntime="66.936396ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:45.172118586 +0000 UTC m=+85.859983027" watchObservedRunningTime="2026-07-27 19:06:45.173387533 +0000 UTC m=+85.861251971"
Jul 27 19:06:45.188732 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.188688    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7878bb7d-8999p" podStartSLOduration=1.892208463 podStartE2EDuration="25.188677989s" totalImagesPullingTime="23.296469526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:45.187958314 +0000 UTC m=+85.875822765" watchObservedRunningTime="2026-07-27 19:06:45.188677989 +0000 UTC m=+85.876542427"
Jul 27 19:06:45.374203 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.374166    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:45.474164 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.474102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:45.637242 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.637214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:45.737023 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:45.736961    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:47.230493 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:47.230462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:47.299780 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:47.299754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:47.764180 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:47.764156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:48.639464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:48.639423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:49.437764 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:49.437731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:49.514846 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:49.514818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:50.152027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:50.151993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:50.253396 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:50.253376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:51.153082 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:51.153059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:51.255526 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:51.255505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:51.732904 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:51.732877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:51.817737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:51.817705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:52.157334 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:52.157317    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:52.207793 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:52.207770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:53.132731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:53.132707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:53.224660 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:53.224634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:56.979843 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:56.979807    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:06:57.068001 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:06:57.067971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:01.625848 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:01.625812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:01.726858 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:01.726825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:01.791456 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:01.791429    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:03.699696 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:03.699667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:03.799167 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:03.799137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:04.118766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:04.118745    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lrvxl"
Jul 27 19:07:21.748334 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:21.748295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:21.821835 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:21.821803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:29.279051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:29.278987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv" event={"ID":"55d0d51e-5ac1-45f4-8732-9271ca250ebd","Type":"ContainerStarted","Data":"b581aa8908e09bc84cfa97fe4a3a60607fa45b6a75b361b84746b4d44cf6cb24"}
Jul 27 19:07:29.279051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:29.279027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv" event={"ID":"55d0d51e-5ac1-45f4-8732-9271ca250ebd","Type":"ContainerStarted","Data":"36dc6762fa7ca1d3b031d2c95fb14938fccc360dfb358bd2344e460a17af3477"}
Jul 27 19:07:29.279051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:29.279040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv" event={"ID":"55d0d51e-5ac1-45f4-8732-9271ca250ebd","Type":"ContainerStarted","Data":"abb925b6eaae34855d7b00898129d7b8f61d489014535e3bc1ef8d11f08e9335"}
Jul 27 19:07:29.303911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:29.303867    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-97f998bfb-kzqfv" podStartSLOduration=1.679176403 podStartE2EDuration="1m9.30385337s" totalImagesPullingTime="1m7.624676967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:07:29.301927929 +0000 UTC m=+129.989792366" watchObservedRunningTime="2026-07-27 19:07:29.30385337 +0000 UTC m=+129.991717807"
Jul 27 19:07:58.552888 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:58.552813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:07:58.634711 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:07:58.634679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:00.073790 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:00.073758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:10.762794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:10.762713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:10.855235 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:10.855187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:12.083521 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:12.083494    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:18.282789 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:18.282750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:18.358337 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:18.358299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:18.436531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:18.436496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:19.024509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:19.024474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:19.096202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:19.096170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:21.758478 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:21.758434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:21.866775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:21.866736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:29.063771 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:29.063733    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:29.164267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:29.164216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:29.232166 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:29.232143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:59.561228 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:59.561194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:08:59.638591 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:08:59.638561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:05.384961 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:05.384924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:05.486344 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:05.486316    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:32.747731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:32.747702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:33.578715 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:33.578663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:36.535964 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:36.535910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:36.592149 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:36.592113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:37.705304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:37.705273    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:37.868692 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:37.868640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:38.778731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:38.778708    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:38.877008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:38.876990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:39.813147 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.813127    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw75b"]
Jul 27 19:09:39.815894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.815880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:39.818786 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.818771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 19:09:39.819507 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.819488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xdr79\""
Jul 27 19:09:39.819507 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.819504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 19:09:39.827590 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.827568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw75b"]
Jul 27 19:09:39.973188 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.973166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxlx4\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-kube-api-access-kxlx4\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:39.973342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:39.973217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.073883 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.073835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.073883 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.073865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxlx4\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-kube-api-access-kxlx4\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.083707 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.083686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.083926 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.083909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxlx4\" (UniqueName: \"kubernetes.io/projected/e9626a44-dae3-49d4-9d80-df9286e786ca-kube-api-access-kxlx4\") pod \"cert-manager-webhook-6486ffd997-sw75b\" (UID: \"e9626a44-dae3-49d4-9d80-df9286e786ca\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.125007 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.124978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:40.253913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.253889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw75b"]
Jul 27 19:09:40.256207 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:09:40.256181    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9626a44_dae3_49d4_9d80_df9286e786ca.slice/crio-7c8748f4f6171ed780d1ce27b9f004ec35d3c3222d218d28644d5ac4922f3a39 WatchSource:0}: Error finding container 7c8748f4f6171ed780d1ce27b9f004ec35d3c3222d218d28644d5ac4922f3a39: Status 404 returned error can't find the container with id 7c8748f4f6171ed780d1ce27b9f004ec35d3c3222d218d28644d5ac4922f3a39
Jul 27 19:09:40.667138 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.667108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b" event={"ID":"e9626a44-dae3-49d4-9d80-df9286e786ca","Type":"ContainerStarted","Data":"7c8748f4f6171ed780d1ce27b9f004ec35d3c3222d218d28644d5ac4922f3a39"}
Jul 27 19:09:40.705822 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:40.705796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:41.080349 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:41.080155    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:43.132952 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:43.132921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:43.233847 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:43.233809    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:43.678472 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:43.678412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b" event={"ID":"e9626a44-dae3-49d4-9d80-df9286e786ca","Type":"ContainerStarted","Data":"caed02ac5b371a23527d5cfc8d24770d466f769cd769d24e1501c3bff744cb80"}
Jul 27 19:09:43.678472 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:43.678463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:43.701558 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:43.701515    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b" podStartSLOduration=1.589181962 podStartE2EDuration="4.701500979s" totalImagesPullingTime="3.112319017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:43.700145285 +0000 UTC m=+264.388009723" watchObservedRunningTime="2026-07-27 19:09:43.701500979 +0000 UTC m=+264.389365418"
Jul 27 19:09:46.350266 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:46.350216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:46.448753 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:46.448720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:49.482955 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:49.482916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:49.683554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:49.683530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sw75b"
Jul 27 19:09:52.812759 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:52.812731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:52.967682 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:52.967648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:53.098181 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:53.098096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:55.023823 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:55.023781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:09:59.375662 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.375622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxnfd"]
Jul 27 19:09:59.381697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.381671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.384212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.384190    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9jkjx\""
Jul 27 19:09:59.388737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.388717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxnfd"]
Jul 27 19:09:59.489146 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.489123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.489234 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.489154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97sjs\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-kube-api-access-97sjs\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.590173 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.590156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.590282 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.590181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97sjs\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-kube-api-access-97sjs\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.598586 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.598565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-bound-sa-token\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.599119 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.599101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97sjs\" (UniqueName: \"kubernetes.io/projected/a9dbf891-4dbe-4c06-ac03-750de730872e-kube-api-access-97sjs\") pod \"cert-manager-55b4d954d5-wxnfd\" (UID: \"a9dbf891-4dbe-4c06-ac03-750de730872e\") " pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.690893 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.690848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wxnfd"
Jul 27 19:09:59.811523 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:09:59.811494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wxnfd"]
Jul 27 19:09:59.814751 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:09:59.814724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9dbf891_4dbe_4c06_ac03_750de730872e.slice/crio-8d4f8ddae00afeb82a479690b661fbfd94273afc70af911c4eb815d7949f9c44 WatchSource:0}: Error finding container 8d4f8ddae00afeb82a479690b661fbfd94273afc70af911c4eb815d7949f9c44: Status 404 returned error can't find the container with id 8d4f8ddae00afeb82a479690b661fbfd94273afc70af911c4eb815d7949f9c44
Jul 27 19:10:00.736996 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:00.736959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wxnfd" event={"ID":"a9dbf891-4dbe-4c06-ac03-750de730872e","Type":"ContainerStarted","Data":"524fc970014cec5a560e9fade29d4427ef3728b56d2316aeb6125446237dd968"}
Jul 27 19:10:00.737355 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:00.737007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wxnfd" event={"ID":"a9dbf891-4dbe-4c06-ac03-750de730872e","Type":"ContainerStarted","Data":"8d4f8ddae00afeb82a479690b661fbfd94273afc70af911c4eb815d7949f9c44"}
Jul 27 19:10:00.753294 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:00.753231    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wxnfd" podStartSLOduration=1.753216794 podStartE2EDuration="1.753216794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:00.752890701 +0000 UTC m=+281.440755159" watchObservedRunningTime="2026-07-27 19:10:00.753216794 +0000 UTC m=+281.441081231"
Jul 27 19:10:11.939687 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:11.939654    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:12.080486 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.080448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:12.547451 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.547432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:12.932656 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.932628    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"]
Jul 27 19:10:12.935659 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.935643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:12.939203 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.939187    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:10:12.950045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.950030    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:10:12.957864 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.957847    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:10:12.959481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.959466    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzws5\""
Jul 27 19:10:12.959638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.959624    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:10:12.972067 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:12.972048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"]
Jul 27 19:10:13.068804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.068782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.068897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.068806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2jr\" (UniqueName: \"kubernetes.io/projected/e976d1bb-453a-480b-90f5-1dbd36655b0c-kube-api-access-5w2jr\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.068897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.068834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.068897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.068850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.069038 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.068958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170178    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2jr\" (UniqueName: \"kubernetes.io/projected/e976d1bb-453a-480b-90f5-1dbd36655b0c-kube-api-access-5w2jr\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.170592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.170572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.172556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.172532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e976d1bb-453a-480b-90f5-1dbd36655b0c-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.172632 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.172561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.172745 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.172726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e976d1bb-453a-480b-90f5-1dbd36655b0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.186037 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.185990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2jr\" (UniqueName: \"kubernetes.io/projected/e976d1bb-453a-480b-90f5-1dbd36655b0c-kube-api-access-5w2jr\") pod \"opendatahub-operator-controller-manager-9459789d9-69trh\" (UID: \"e976d1bb-453a-480b-90f5-1dbd36655b0c\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.187627 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.187603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.244721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.244698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:13.280786 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.280754    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.362959 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.362930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.380022 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.380008    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"]
Jul 27 19:10:13.382602 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:10:13.382572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode976d1bb_453a_480b_90f5_1dbd36655b0c.slice/crio-8ff2e6cdd10e35f1b2bd7815a65f8482a21dbe8a72b09f0d6aa96e20df4dd8b5 WatchSource:0}: Error finding container 8ff2e6cdd10e35f1b2bd7815a65f8482a21dbe8a72b09f0d6aa96e20df4dd8b5: Status 404 returned error can't find the container with id 8ff2e6cdd10e35f1b2bd7815a65f8482a21dbe8a72b09f0d6aa96e20df4dd8b5
Jul 27 19:10:13.440997 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.440938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.541214 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.541186    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.642424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.642398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:13.779835 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:13.779787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh" event={"ID":"e976d1bb-453a-480b-90f5-1dbd36655b0c","Type":"ContainerStarted","Data":"8ff2e6cdd10e35f1b2bd7815a65f8482a21dbe8a72b09f0d6aa96e20df4dd8b5"}
Jul 27 19:10:16.307414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:16.307385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:16.789660 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:16.789628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh" event={"ID":"e976d1bb-453a-480b-90f5-1dbd36655b0c","Type":"ContainerStarted","Data":"8cd2a1f5c8d656160965c166ef0033fd2ea046a723e94fd0757b2a1a945e5ebf"}
Jul 27 19:10:17.794282 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:17.794229    2560 generic.go:356] "Generic (PLEG): container finished" podID="e976d1bb-453a-480b-90f5-1dbd36655b0c" containerID="8cd2a1f5c8d656160965c166ef0033fd2ea046a723e94fd0757b2a1a945e5ebf" exitCode=0
Jul 27 19:10:17.794570 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:17.794296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh" event={"ID":"e976d1bb-453a-480b-90f5-1dbd36655b0c","Type":"ContainerDied","Data":"8cd2a1f5c8d656160965c166ef0033fd2ea046a723e94fd0757b2a1a945e5ebf"}
Jul 27 19:10:18.799733 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:18.799705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh" event={"ID":"e976d1bb-453a-480b-90f5-1dbd36655b0c","Type":"ContainerStarted","Data":"9e40164b9a22d31861e295811b85ff470153d52ba6715eabb00fbff48de8b36a"}
Jul 27 19:10:18.800028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:18.799826    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:18.820932 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:18.820889    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh" podStartSLOduration=1.894172663 podStartE2EDuration="6.820875472s" totalImagesPullingTime="3.958985203s" totalInitContainerRuntime="967.717606ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:18.81943511 +0000 UTC m=+299.507299591" watchObservedRunningTime="2026-07-27 19:10:18.820875472 +0000 UTC m=+299.508739909"
Jul 27 19:10:19.654459 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:19.654436    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:10:24.680134 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:24.680096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:26.493216 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:26.493183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:29.803788 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:29.803764    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-69trh"
Jul 27 19:10:33.414010 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:33.413976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:33.578522 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:33.578488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:33.937369 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:33.937314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:34.242428 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:34.242320    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:34.366804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:34.366763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:34.531045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:34.530961    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:34.654290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:34.654229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:35.325860 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:35.325828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:35.424757 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:35.424722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:35.572733 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:35.572700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:35.648489 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:35.648458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:36.648075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:36.648041    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:36.970138 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:36.970065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.038275 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.038214    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"]
Jul 27 19:10:37.045639 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.045613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.049215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049178    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:10:37.049215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049191    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 19:10:37.049215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049184    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 19:10:37.049455 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049223    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:10:37.049455 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mbblb\""
Jul 27 19:10:37.049455 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.049180    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 19:10:37.056186 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.056162    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"]
Jul 27 19:10:37.058373 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.058349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:37.138503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.138474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2722l\" (UniqueName: \"kubernetes.io/projected/bc033c07-8330-40d9-9a3f-56e105329bcb-kube-api-access-2722l\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.138697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.138533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc033c07-8330-40d9-9a3f-56e105329bcb-manager-config\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.138697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.138555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.138697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.138575    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.239514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.239428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc033c07-8330-40d9-9a3f-56e105329bcb-manager-config\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.239514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.239469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.239514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.239491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.239514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.239515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2722l\" (UniqueName: \"kubernetes.io/projected/bc033c07-8330-40d9-9a3f-56e105329bcb-kube-api-access-2722l\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.240201 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.240165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc033c07-8330-40d9-9a3f-56e105329bcb-manager-config\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.242341 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.242313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.242457 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.242356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc033c07-8330-40d9-9a3f-56e105329bcb-cert\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.247948 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.247924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2722l\" (UniqueName: \"kubernetes.io/projected/bc033c07-8330-40d9-9a3f-56e105329bcb-kube-api-access-2722l\") pod \"lws-controller-manager-6898ff9d7-btxrc\" (UID: \"bc033c07-8330-40d9-9a3f-56e105329bcb\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.355154 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.355122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:37.490534 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.490511    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"]
Jul 27 19:10:37.492884 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:10:37.492855    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc033c07_8330_40d9_9a3f_56e105329bcb.slice/crio-3f870f89ca537d83ad34c9ef96afd99878d0415147c952f1ff314bc3c9979fef WatchSource:0}: Error finding container 3f870f89ca537d83ad34c9ef96afd99878d0415147c952f1ff314bc3c9979fef: Status 404 returned error can't find the container with id 3f870f89ca537d83ad34c9ef96afd99878d0415147c952f1ff314bc3c9979fef
Jul 27 19:10:37.494733 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.494711    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:10:37.861439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:37.861361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc" event={"ID":"bc033c07-8330-40d9-9a3f-56e105329bcb","Type":"ContainerStarted","Data":"3f870f89ca537d83ad34c9ef96afd99878d0415147c952f1ff314bc3c9979fef"}
Jul 27 19:10:40.725916 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:40.725880    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:40.821783 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:40.821755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:40.878786 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:40.878756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc" event={"ID":"bc033c07-8330-40d9-9a3f-56e105329bcb","Type":"ContainerStarted","Data":"f0ee2a3af01e337fed53e22163edfa061ce6e83178e58855f087730d6cee0405"}
Jul 27 19:10:40.878917 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:40.878883    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:10:40.894860 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:40.894805    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc" podStartSLOduration=0.728654473 podStartE2EDuration="3.894793044s" totalImagesPullingTime="3.166138571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:40.894422279 +0000 UTC m=+321.582286719" watchObservedRunningTime="2026-07-27 19:10:40.894793044 +0000 UTC m=+321.582657482"
Jul 27 19:10:41.400357 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.400328    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"]
Jul 27 19:10:41.404741 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.404707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.407767 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.407750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:10:41.408123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.408100    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:10:41.408283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.408108    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-r9zmj\""
Jul 27 19:10:41.409684 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.409661    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:10:41.421691 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.421671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"]
Jul 27 19:10:41.461130 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.461101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:41.476465 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8q6\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-kube-api-access-xh8q6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476725 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476725 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.476786 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.476723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577118 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8q6\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-kube-api-access-xh8q6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577311 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577694 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577694 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.577866 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.577816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.578221 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.578199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.579424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.579407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.579740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.579717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.589781 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.589762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8q6\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-kube-api-access-xh8q6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.592373 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.592357    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c6860c-c6a7-4355-b1c0-e65054bf4bba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87\" (UID: \"e9c6860c-c6a7-4355-b1c0-e65054bf4bba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.691936 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.691883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:41.714660 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.714641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:41.857235 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.857208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:41.864196 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.864175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"]
Jul 27 19:10:41.867520 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:10:41.867497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c6860c_c6a7_4355_b1c0_e65054bf4bba.slice/crio-717b5644a0e4e06f87da73836cffdaa524b384f3b5698f0b56970e01c7dde951 WatchSource:0}: Error finding container 717b5644a0e4e06f87da73836cffdaa524b384f3b5698f0b56970e01c7dde951: Status 404 returned error can't find the container with id 717b5644a0e4e06f87da73836cffdaa524b384f3b5698f0b56970e01c7dde951
Jul 27 19:10:41.883421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:41.883398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87" event={"ID":"e9c6860c-c6a7-4355-b1c0-e65054bf4bba","Type":"ContainerStarted","Data":"717b5644a0e4e06f87da73836cffdaa524b384f3b5698f0b56970e01c7dde951"}
Jul 27 19:10:44.914534 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:44.914488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.049440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.049355    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"]
Jul 27 19:10:45.059469 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.059441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.066174 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.066113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.067274 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.067204    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 19:10:45.067405 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.067316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dg9x9\""
Jul 27 19:10:45.071048 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.070932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"]
Jul 27 19:10:45.100561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.100486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq5z\" (UniqueName: \"kubernetes.io/projected/712274e1-4ae2-4469-b7e4-acaba07feaf5-kube-api-access-dcq5z\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.100731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.100594    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.201200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.201117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq5z\" (UniqueName: \"kubernetes.io/projected/712274e1-4ae2-4469-b7e4-acaba07feaf5-kube-api-access-dcq5z\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.201200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.201197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.201408 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:10:45.201374    2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 19:10:45.201463 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:10:45.201441    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert podName:712274e1-4ae2-4469-b7e4-acaba07feaf5 nodeName:}" failed. No retries permitted until 2026-07-27 19:10:45.701420232 +0000 UTC m=+326.389284656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert") pod "kserve-controller-manager-d6f4b65b8-ksnmw" (UID: "712274e1-4ae2-4469-b7e4-acaba07feaf5") : secret "kserve-webhook-server-cert" not found
Jul 27 19:10:45.213074 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.213044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq5z\" (UniqueName: \"kubernetes.io/projected/712274e1-4ae2-4469-b7e4-acaba07feaf5-kube-api-access-dcq5z\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.243388 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.243353    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:45.243504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.243425    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:45.243504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.243453    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:10:45.286229 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.286206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.386272 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.386206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.556384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.556300    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.705555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.705523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:45.705676 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:10:45.705665    2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 19:10:45.705742 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:10:45.705731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert podName:712274e1-4ae2-4469-b7e4-acaba07feaf5 nodeName:}" failed. No retries permitted until 2026-07-27 19:10:46.705712313 +0000 UTC m=+327.393576731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert") pod "kserve-controller-manager-d6f4b65b8-ksnmw" (UID: "712274e1-4ae2-4469-b7e4-acaba07feaf5") : secret "kserve-webhook-server-cert" not found
Jul 27 19:10:45.763957 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.763921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.891429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.891395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:10:45.900101 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.900081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87" event={"ID":"e9c6860c-c6a7-4355-b1c0-e65054bf4bba","Type":"ContainerStarted","Data":"de603b34e8072cdc85e50d6484beea265ce08589b1a57cdc3bd4ed7c16463dfb"}
Jul 27 19:10:45.922019 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:45.921974    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87" podStartSLOduration=1.548592999 podStartE2EDuration="4.92196006s" totalImagesPullingTime="3.373367061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:45.92005371 +0000 UTC m=+326.607918161" watchObservedRunningTime="2026-07-27 19:10:45.92196006 +0000 UTC m=+326.609824497"
Jul 27 19:10:46.712875 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.712845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:46.715020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.715000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:46.715319 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.715302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712274e1-4ae2-4469-b7e4-acaba07feaf5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ksnmw\" (UID: \"712274e1-4ae2-4469-b7e4-acaba07feaf5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:46.720072 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.720051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:46.877055 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.877030    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:46.903896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.903858    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:46.904957 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:46.904939    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87"
Jul 27 19:10:47.052760 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:10:47.052729    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712274e1_4ae2_4469_b7e4_acaba07feaf5.slice/crio-f3582d07d59c40dbcf6ff2edc9ec0602561f420c292aab57bee519356e377be5 WatchSource:0}: Error finding container f3582d07d59c40dbcf6ff2edc9ec0602561f420c292aab57bee519356e377be5: Status 404 returned error can't find the container with id f3582d07d59c40dbcf6ff2edc9ec0602561f420c292aab57bee519356e377be5
Jul 27 19:10:47.053946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:47.053920    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"]
Jul 27 19:10:47.908919 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:47.908891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw" event={"ID":"712274e1-4ae2-4469-b7e4-acaba07feaf5","Type":"ContainerStarted","Data":"f3582d07d59c40dbcf6ff2edc9ec0602561f420c292aab57bee519356e377be5"}
Jul 27 19:10:49.921235 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:49.921206    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw" event={"ID":"712274e1-4ae2-4469-b7e4-acaba07feaf5","Type":"ContainerStarted","Data":"770113f2d4371e58e76c59b1de5731cb11a45e84b2e4ff92582d33c160d47384"}
Jul 27 19:10:49.921556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:49.921406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:10:49.938433 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:49.938115    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw" podStartSLOduration=2.195354677 podStartE2EDuration="4.938095094s" totalImagesPullingTime="2.742740417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:49.936972468 +0000 UTC m=+330.624836907" watchObservedRunningTime="2026-07-27 19:10:49.938095094 +0000 UTC m=+330.625959535"
Jul 27 19:10:51.886139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:10:51.886111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-btxrc"
Jul 27 19:11:20.930107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:20.930042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ksnmw"
Jul 27 19:11:33.233348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:33.233310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:33.331741 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:33.331707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:35.089962 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:35.089923    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:35.156467 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:35.156435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:35.780966 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:35.780942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:35.983272 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:35.983217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:11:55.660567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:11:55.660532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:03.738021 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:03.737977    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:06.170180 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:06.170144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:06.270762 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:06.270736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:06.362616 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:06.362593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:07.318883 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:07.318856    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:10.356724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:10.356692    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:11.869726 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:11.869681    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:12.727315 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:12.727286    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:14.707145 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.707114    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"]
Jul 27 19:12:14.710028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.710011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:14.712918 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.712897    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:12:14.713376 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.713363    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:12:14.719041 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.719028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dz8mf\""
Jul 27 19:12:14.752273 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.752238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"]
Jul 27 19:12:14.804490 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.804472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghgjl\" (UniqueName: \"kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl\") pod \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" (UID: \"7c0aeca1-6d7f-460a-b978-d8f560227afd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:14.905199 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.905181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghgjl\" (UniqueName: \"kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl\") pod \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" (UID: \"7c0aeca1-6d7f-460a-b978-d8f560227afd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:14.913289 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.913270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghgjl\" (UniqueName: \"kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl\") pod \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" (UID: \"7c0aeca1-6d7f-460a-b978-d8f560227afd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:14.931286 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:14.931267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:15.018853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.018797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:15.145767 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.145742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"]
Jul 27 19:12:15.147788 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:12:15.147764    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0aeca1_6d7f_460a_b978_d8f560227afd.slice/crio-a841ced2ecdebf4b7a6b9f3bf3efef0bdf1fdd5da6b3548e24869e8388bd8ed1 WatchSource:0}: Error finding container a841ced2ecdebf4b7a6b9f3bf3efef0bdf1fdd5da6b3548e24869e8388bd8ed1: Status 404 returned error can't find the container with id a841ced2ecdebf4b7a6b9f3bf3efef0bdf1fdd5da6b3548e24869e8388bd8ed1
Jul 27 19:12:15.191398 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.191370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl" event={"ID":"7c0aeca1-6d7f-460a-b978-d8f560227afd","Type":"ContainerStarted","Data":"a841ced2ecdebf4b7a6b9f3bf3efef0bdf1fdd5da6b3548e24869e8388bd8ed1"}
Jul 27 19:12:15.331503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.331437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:15.642632 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.642602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:15.739514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:15.739492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:18.205230 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:18.205196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl" event={"ID":"7c0aeca1-6d7f-460a-b978-d8f560227afd","Type":"ContainerStarted","Data":"21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844"}
Jul 27 19:12:18.205556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:18.205323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:18.226295 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:18.226232    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl" podStartSLOduration=1.984343848 podStartE2EDuration="4.226194289s" totalImagesPullingTime="2.241850441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:18.224727371 +0000 UTC m=+418.912591824" watchObservedRunningTime="2026-07-27 19:12:18.226194289 +0000 UTC m=+418.914058727"
Jul 27 19:12:18.365074 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:18.365052    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:19.727884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:19.727850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:19.830457 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:19.830431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:21.696569 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.696535    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"]
Jul 27 19:12:21.699574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.699554    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.701810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.701764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 19:12:21.701810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.701789    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 19:12:21.702064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.702044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sqrg8\""
Jul 27 19:12:21.710026 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.709990    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"]
Jul 27 19:12:21.710356 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.710333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:21.845665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.845637    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:21.852677 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.852654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ljm\" (UniqueName: \"kubernetes.io/projected/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-kube-api-access-56ljm\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.852770 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.852680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.852770 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.852707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.953371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.953310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.953471 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.953378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ljm\" (UniqueName: \"kubernetes.io/projected/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-kube-api-access-56ljm\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.953471 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.953396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.953471 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:21.953435    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 19:12:21.953612 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:21.953495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert podName:5231f95e-7029-4b78-bd5f-fce5dcfb6d58 nodeName:}" failed. No retries permitted until 2026-07-27 19:12:22.453478457 +0000 UTC m=+423.141342877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-h6vwh" (UID: "5231f95e-7029-4b78-bd5f-fce5dcfb6d58") : secret "plugin-serving-cert" not found
Jul 27 19:12:21.953968 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.953952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:21.961571 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:21.961554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ljm\" (UniqueName: \"kubernetes.io/projected/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-kube-api-access-56ljm\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:22.457887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:22.457863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:22.460742 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:22.460718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5231f95e-7029-4b78-bd5f-fce5dcfb6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h6vwh\" (UID: \"5231f95e-7029-4b78-bd5f-fce5dcfb6d58\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:22.505017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:22.504978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:22.608300 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:22.608281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"
Jul 27 19:12:22.724880 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:22.724819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh"]
Jul 27 19:12:22.727652 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:12:22.727629    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5231f95e_7029_4b78_bd5f_fce5dcfb6d58.slice/crio-2d2a5ee9b25cd900551934a6942a4773b8781d6ee4ceca8825d37b2ae330bcc3 WatchSource:0}: Error finding container 2d2a5ee9b25cd900551934a6942a4773b8781d6ee4ceca8825d37b2ae330bcc3: Status 404 returned error can't find the container with id 2d2a5ee9b25cd900551934a6942a4773b8781d6ee4ceca8825d37b2ae330bcc3
Jul 27 19:12:23.225170 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:23.225143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh" event={"ID":"5231f95e-7029-4b78-bd5f-fce5dcfb6d58","Type":"ContainerStarted","Data":"2d2a5ee9b25cd900551934a6942a4773b8781d6ee4ceca8825d37b2ae330bcc3"}
Jul 27 19:12:23.403143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:23.403110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:23.500811 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:23.500755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:29.210573 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:29.210546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:30.811809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:30.811767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:30.908056 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:30.908005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:32.000378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.000342    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"]
Jul 27 19:12:32.000823 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.000575    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" containerName="manager" containerID="cri-o://21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844" gracePeriod=2
Jul 27 19:12:32.016006 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.015971    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"]
Jul 27 19:12:32.018897 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:32.018859    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7c0aeca1-6d7f-460a-b978-d8f560227afd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8qwgl\": pods \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:32.026501 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.026477    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"]
Jul 27 19:12:32.026749 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.026736    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" containerName="manager"
Jul 27 19:12:32.026819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.026750    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" containerName="manager"
Jul 27 19:12:32.026819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.026812    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" containerName="manager"
Jul 27 19:12:32.029979 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.029956    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:32.032420 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:32.032343    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:32.032571 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.032541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgjd\" (UniqueName: \"kubernetes.io/projected/99130f6b-ee23-4c2a-8eb9-349f0d2f5d61-kube-api-access-hwgjd\") pod \"limitador-operator-controller-manager-859d7b78bd-g6jc2\" (UID: \"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:32.047608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.047553    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"]
Jul 27 19:12:32.133444 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.133410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgjd\" (UniqueName: \"kubernetes.io/projected/99130f6b-ee23-4c2a-8eb9-349f0d2f5d61-kube-api-access-hwgjd\") pod \"limitador-operator-controller-manager-859d7b78bd-g6jc2\" (UID: \"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:32.144474 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.144449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgjd\" (UniqueName: \"kubernetes.io/projected/99130f6b-ee23-4c2a-8eb9-349f0d2f5d61-kube-api-access-hwgjd\") pod \"limitador-operator-controller-manager-859d7b78bd-g6jc2\" (UID: \"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:32.385012 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:32.384982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:35.577002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:35.576954    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:35.669861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:35.669821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:38.025153 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:38.025108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:38.125018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:38.124971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:41.441059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:41.440964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:41.544144 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:41.544088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:44.976414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:44.976389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:44.977766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:44.977749    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"]
Jul 27 19:12:44.978745 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:44.978723    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:44.980325 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:12:44.980302    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99130f6b_ee23_4c2a_8eb9_349f0d2f5d61.slice/crio-afe488d41dad4c100c2f725b175e94cecaa10816ea44996570bfb355b2d8422f WatchSource:0}: Error finding container afe488d41dad4c100c2f725b175e94cecaa10816ea44996570bfb355b2d8422f: Status 404 returned error can't find the container with id afe488d41dad4c100c2f725b175e94cecaa10816ea44996570bfb355b2d8422f
Jul 27 19:12:45.045688 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.045668    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghgjl\" (UniqueName: \"kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl\") pod \"7c0aeca1-6d7f-460a-b978-d8f560227afd\" (UID: \"7c0aeca1-6d7f-460a-b978-d8f560227afd\") "
Jul 27 19:12:45.047624 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.047604    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl" (OuterVolumeSpecName: "kube-api-access-ghgjl") pod "7c0aeca1-6d7f-460a-b978-d8f560227afd" (UID: "7c0aeca1-6d7f-460a-b978-d8f560227afd"). InnerVolumeSpecName "kube-api-access-ghgjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:45.146397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.146367    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghgjl\" (UniqueName: \"kubernetes.io/projected/7c0aeca1-6d7f-460a-b978-d8f560227afd-kube-api-access-ghgjl\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:12:45.321593 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.321567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh" event={"ID":"5231f95e-7029-4b78-bd5f-fce5dcfb6d58","Type":"ContainerStarted","Data":"9517e2ce6c80268820325e6b10e64321748e905fc3567e257fc06a489530ab0a"}
Jul 27 19:12:45.322871 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.322849    2560 generic.go:356] "Generic (PLEG): container finished" podID="7c0aeca1-6d7f-460a-b978-d8f560227afd" containerID="21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844" exitCode=0
Jul 27 19:12:45.322978 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.322890    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:45.322978 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.322933    2560 scope.go:117] "RemoveContainer" containerID="21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844"
Jul 27 19:12:45.324083 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:45.323943    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:45.324563 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.324545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2" event={"ID":"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61","Type":"ContainerStarted","Data":"ec1594ee8b5afd84663cbb9848e1a6365c0271a188f8b5921e07c0c6d8ca5edf"}
Jul 27 19:12:45.324650 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.324579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2" event={"ID":"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61","Type":"ContainerStarted","Data":"afe488d41dad4c100c2f725b175e94cecaa10816ea44996570bfb355b2d8422f"}
Jul 27 19:12:45.324650 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.324600    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:12:45.330668 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.330655    2560 scope.go:117] "RemoveContainer" containerID="21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844"
Jul 27 19:12:45.330905 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:45.330885    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844\": container with ID starting with 21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844 not found: ID does not exist" containerID="21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844"
Jul 27 19:12:45.330969 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.330914    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844"} err="failed to get container status \"21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844\": rpc error: code = NotFound desc = could not find container \"21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844\": container with ID starting with 21494794a17a9627f91c70a2106bf3bc94942a1dd6a9701ce63c8480a580e844 not found: ID does not exist"
Jul 27 19:12:45.344240 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:12:45.344207    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8qwgl\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8qwgl"
Jul 27 19:12:45.348721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.348682    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h6vwh" podStartSLOduration=2.146613071 podStartE2EDuration="24.34866968s" totalImagesPullingTime="22.202056609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:45.342089472 +0000 UTC m=+446.029953935" watchObservedRunningTime="2026-07-27 19:12:45.34866968 +0000 UTC m=+446.036534116"
Jul 27 19:12:45.367290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.367227    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2" podStartSLOduration=13.367211517 podStartE2EDuration="13.367211517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:45.366382038 +0000 UTC m=+446.054246475" watchObservedRunningTime="2026-07-27 19:12:45.367211517 +0000 UTC m=+446.055075955"
Jul 27 19:12:45.780623 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:45.780597    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0aeca1-6d7f-460a-b978-d8f560227afd" path="/var/lib/kubelet/pods/7c0aeca1-6d7f-460a-b978-d8f560227afd/volumes"
Jul 27 19:12:48.473550 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:48.473516    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:48.590113 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:48.590086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:53.270548 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:53.270509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:53.371640 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:53.371608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:12:56.331702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:12:56.331674    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:13:00.709204 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.709171    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"]
Jul 27 19:13:00.714640 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.714619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.717140 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.717123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7jbnt\""
Jul 27 19:13:00.723572 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.723552    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"]
Jul 27 19:13:00.838179 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.838154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:00.851385 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851473 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851473 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851473 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851614 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851614 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00878697-68fd-4c92-ad75-7fe7bdb43246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851614 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nwjl\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-kube-api-access-9nwjl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.851785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.851672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.937647 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.937612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:00.952752 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.952845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.952845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.952845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.952845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00878697-68fd-4c92-ad75-7fe7bdb43246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.952854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nwjl\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-kube-api-access-9nwjl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953172 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953496 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953627 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00878697-68fd-4c92-ad75-7fe7bdb43246-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.953702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.953361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.955374 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.955353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.955879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.955849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.961080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.961026    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:00.961374 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:00.961356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nwjl\" (UniqueName: \"kubernetes.io/projected/00878697-68fd-4c92-ad75-7fe7bdb43246-kube-api-access-9nwjl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-96grz\" (UID: \"00878697-68fd-4c92-ad75-7fe7bdb43246\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:01.025292 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.025266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:01.153552 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.153500    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"]
Jul 27 19:13:01.155935 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:13:01.155911    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00878697_68fd_4c92_ad75_7fe7bdb43246.slice/crio-a2d191606aa441ca25385acde1102efd5e09462bdd9ccc680682b66f82c4aa99 WatchSource:0}: Error finding container a2d191606aa441ca25385acde1102efd5e09462bdd9ccc680682b66f82c4aa99: Status 404 returned error can't find the container with id a2d191606aa441ca25385acde1102efd5e09462bdd9ccc680682b66f82c4aa99
Jul 27 19:13:01.157811 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.157780    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:13:01.157903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.157846    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:13:01.157903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.157874    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:13:01.384037 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.384010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" event={"ID":"00878697-68fd-4c92-ad75-7fe7bdb43246","Type":"ContainerStarted","Data":"d52e3b9ae63c35d7495076295d2e72d7c72a6d25eda105d60222b9839896940f"}
Jul 27 19:13:01.384193 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.384055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" event={"ID":"00878697-68fd-4c92-ad75-7fe7bdb43246","Type":"ContainerStarted","Data":"a2d191606aa441ca25385acde1102efd5e09462bdd9ccc680682b66f82c4aa99"}
Jul 27 19:13:01.410451 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:01.410400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podStartSLOduration=1.410384248 podStartE2EDuration="1.410384248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:01.402404782 +0000 UTC m=+462.090269219" watchObservedRunningTime="2026-07-27 19:13:01.410384248 +0000 UTC m=+462.098248685"
Jul 27 19:13:02.025910 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:02.025882    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:02.029653 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:02.029635    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:02.388123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:02.388099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:02.388785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:02.388772    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:13:22.083017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.082982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:22.180613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.180576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:22.243528 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.243484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:22.878506 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.878473    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:22.895894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.895866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:22.896028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.895947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:22.898650 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.898627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n8q5m\""
Jul 27 19:13:22.918076 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.918050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:22.990679 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:22.990652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:23.022571 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.022548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s26s\" (UniqueName: \"kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s\") pod \"authorino-58cd955675-ccfvl\" (UID: \"a681d8af-162b-4ed9-879c-777d71761e9b\") " pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:23.123304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.123277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s26s\" (UniqueName: \"kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s\") pod \"authorino-58cd955675-ccfvl\" (UID: \"a681d8af-162b-4ed9-879c-777d71761e9b\") " pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:23.132139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.132092    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s26s\" (UniqueName: \"kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s\") pod \"authorino-58cd955675-ccfvl\" (UID: \"a681d8af-162b-4ed9-879c-777d71761e9b\") " pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:23.203829 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.203805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:23.324281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.324238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:23.327532 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:13:23.327501    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda681d8af_162b_4ed9_879c_777d71761e9b.slice/crio-90272d5a257be517f51efc4f15d51bec52d5c9f6403c34f3922b636c76ab6417 WatchSource:0}: Error finding container 90272d5a257be517f51efc4f15d51bec52d5c9f6403c34f3922b636c76ab6417: Status 404 returned error can't find the container with id 90272d5a257be517f51efc4f15d51bec52d5c9f6403c34f3922b636c76ab6417
Jul 27 19:13:23.474911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:23.474826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ccfvl" event={"ID":"a681d8af-162b-4ed9-879c-777d71761e9b","Type":"ContainerStarted","Data":"90272d5a257be517f51efc4f15d51bec52d5c9f6403c34f3922b636c76ab6417"}
Jul 27 19:13:27.452296 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:27.452261    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:27.495961 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:27.495926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ccfvl" event={"ID":"a681d8af-162b-4ed9-879c-777d71761e9b","Type":"ContainerStarted","Data":"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"}
Jul 27 19:13:28.499776 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.499741    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ccfvl" podUID="a681d8af-162b-4ed9-879c-777d71761e9b" containerName="authorino" containerID="cri-o://9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056" gracePeriod=30
Jul 27 19:13:28.515087 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.515045    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ccfvl" podStartSLOduration=3.373871657 podStartE2EDuration="6.515029685s" totalImagesPullingTime="3.141158028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:27.511130586 +0000 UTC m=+488.198995025" watchObservedRunningTime="2026-07-27 19:13:28.515029685 +0000 UTC m=+489.202894158"
Jul 27 19:13:28.734217 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.734196    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:28.872537 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.872514    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s26s\" (UniqueName: \"kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s\") pod \"a681d8af-162b-4ed9-879c-777d71761e9b\" (UID: \"a681d8af-162b-4ed9-879c-777d71761e9b\") "
Jul 27 19:13:28.874573 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.874546    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s" (OuterVolumeSpecName: "kube-api-access-7s26s") pod "a681d8af-162b-4ed9-879c-777d71761e9b" (UID: "a681d8af-162b-4ed9-879c-777d71761e9b"). InnerVolumeSpecName "kube-api-access-7s26s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:28.973696 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:28.973676    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s26s\" (UniqueName: \"kubernetes.io/projected/a681d8af-162b-4ed9-879c-777d71761e9b-kube-api-access-7s26s\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:13:29.504509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.504474    2560 generic.go:356] "Generic (PLEG): container finished" podID="a681d8af-162b-4ed9-879c-777d71761e9b" containerID="9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056" exitCode=0
Jul 27 19:13:29.504974 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.504529    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ccfvl"
Jul 27 19:13:29.504974 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.504553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ccfvl" event={"ID":"a681d8af-162b-4ed9-879c-777d71761e9b","Type":"ContainerDied","Data":"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"}
Jul 27 19:13:29.504974 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.504593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ccfvl" event={"ID":"a681d8af-162b-4ed9-879c-777d71761e9b","Type":"ContainerDied","Data":"90272d5a257be517f51efc4f15d51bec52d5c9f6403c34f3922b636c76ab6417"}
Jul 27 19:13:29.504974 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.504609    2560 scope.go:117] "RemoveContainer" containerID="9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"
Jul 27 19:13:29.512817 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.512802    2560 scope.go:117] "RemoveContainer" containerID="9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"
Jul 27 19:13:29.513089 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:13:29.513070    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056\": container with ID starting with 9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056 not found: ID does not exist" containerID="9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"
Jul 27 19:13:29.513141 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.513096    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056"} err="failed to get container status \"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056\": rpc error: code = NotFound desc = could not find container \"9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056\": container with ID starting with 9d98c84b28b018fd5503ff24eade0e5d7121a9794b1009a5d2fdf3eb5ea26056 not found: ID does not exist"
Jul 27 19:13:29.524806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.524787    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:29.529173 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.529153    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ccfvl"]
Jul 27 19:13:29.780817 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:29.780753    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a681d8af-162b-4ed9-879c-777d71761e9b" path="/var/lib/kubelet/pods/a681d8af-162b-4ed9-879c-777d71761e9b/volumes"
Jul 27 19:13:39.265093 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:39.265053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:39.361986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:39.361944    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:39.780850 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:39.780818    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:52.005493 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.005443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:52.104124 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.104089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:13:52.519983 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.519950    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:52.520229 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.520218    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a681d8af-162b-4ed9-879c-777d71761e9b" containerName="authorino"
Jul 27 19:13:52.520317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.520231    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a681d8af-162b-4ed9-879c-777d71761e9b" containerName="authorino"
Jul 27 19:13:52.520317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.520300    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a681d8af-162b-4ed9-879c-777d71761e9b" containerName="authorino"
Jul 27 19:13:52.522343 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.522326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:52.524869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.524853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n8q5m\""
Jul 27 19:13:52.530476 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.530452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:52.550410 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.550380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn6f5\" (UniqueName: \"kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5\") pod \"authorino-676955cd56-pc4c2\" (UID: \"97c19c8b-4f70-4ce3-b68e-dbed634c927d\") " pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:52.651533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.651496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn6f5\" (UniqueName: \"kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5\") pod \"authorino-676955cd56-pc4c2\" (UID: \"97c19c8b-4f70-4ce3-b68e-dbed634c927d\") " pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:52.662581 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.662559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn6f5\" (UniqueName: \"kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5\") pod \"authorino-676955cd56-pc4c2\" (UID: \"97c19c8b-4f70-4ce3-b68e-dbed634c927d\") " pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:52.677123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.677091    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:52.677348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.677336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:52.804861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:52.804779    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:52.807167 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:13:52.807142    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97c19c8b_4f70_4ce3_b68e_dbed634c927d.slice/crio-ffb6d73c5ae535cd3a9bba86142777b88c66bd57e8a21c3fad52bf3dd27861d0 WatchSource:0}: Error finding container ffb6d73c5ae535cd3a9bba86142777b88c66bd57e8a21c3fad52bf3dd27861d0: Status 404 returned error can't find the container with id ffb6d73c5ae535cd3a9bba86142777b88c66bd57e8a21c3fad52bf3dd27861d0
Jul 27 19:13:53.602354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.602228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676955cd56-pc4c2" event={"ID":"97c19c8b-4f70-4ce3-b68e-dbed634c927d","Type":"ContainerStarted","Data":"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"}
Jul 27 19:13:53.602354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.602296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676955cd56-pc4c2" event={"ID":"97c19c8b-4f70-4ce3-b68e-dbed634c927d","Type":"ContainerStarted","Data":"ffb6d73c5ae535cd3a9bba86142777b88c66bd57e8a21c3fad52bf3dd27861d0"}
Jul 27 19:13:53.602354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.602299    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-676955cd56-pc4c2" podUID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" containerName="authorino" containerID="cri-o://4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5" gracePeriod=30
Jul 27 19:13:53.617882 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.617826    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-676955cd56-pc4c2" podStartSLOduration=1.2560368720000001 podStartE2EDuration="1.617808336s" totalImagesPullingTime="361.771464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:53.61753655 +0000 UTC m=+514.305401013" watchObservedRunningTime="2026-07-27 19:13:53.617808336 +0000 UTC m=+514.305672775"
Jul 27 19:13:53.868725 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.868704    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:53.962329 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.962300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn6f5\" (UniqueName: \"kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5\") pod \"97c19c8b-4f70-4ce3-b68e-dbed634c927d\" (UID: \"97c19c8b-4f70-4ce3-b68e-dbed634c927d\") "
Jul 27 19:13:53.964500 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:53.964473    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5" (OuterVolumeSpecName: "kube-api-access-qn6f5") pod "97c19c8b-4f70-4ce3-b68e-dbed634c927d" (UID: "97c19c8b-4f70-4ce3-b68e-dbed634c927d"). InnerVolumeSpecName "kube-api-access-qn6f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:54.063024 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.062996    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn6f5\" (UniqueName: \"kubernetes.io/projected/97c19c8b-4f70-4ce3-b68e-dbed634c927d-kube-api-access-qn6f5\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:13:54.606946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.606913    2560 generic.go:356] "Generic (PLEG): container finished" podID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" containerID="4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5" exitCode=0
Jul 27 19:13:54.607361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.606955    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676955cd56-pc4c2"
Jul 27 19:13:54.607361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.607003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676955cd56-pc4c2" event={"ID":"97c19c8b-4f70-4ce3-b68e-dbed634c927d","Type":"ContainerDied","Data":"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"}
Jul 27 19:13:54.607361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.607040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-676955cd56-pc4c2" event={"ID":"97c19c8b-4f70-4ce3-b68e-dbed634c927d","Type":"ContainerDied","Data":"ffb6d73c5ae535cd3a9bba86142777b88c66bd57e8a21c3fad52bf3dd27861d0"}
Jul 27 19:13:54.607361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.607058    2560 scope.go:117] "RemoveContainer" containerID="4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"
Jul 27 19:13:54.615423 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.615409    2560 scope.go:117] "RemoveContainer" containerID="4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"
Jul 27 19:13:54.615683 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:13:54.615665    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5\": container with ID starting with 4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5 not found: ID does not exist" containerID="4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"
Jul 27 19:13:54.615729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.615691    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5"} err="failed to get container status \"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5\": rpc error: code = NotFound desc = could not find container \"4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5\": container with ID starting with 4d247f97d468528c5536c9ed0fe0f3de823272ee54c4a01ecb2c33e85b6473d5 not found: ID does not exist"
Jul 27 19:13:54.625851 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.625831    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:54.629500 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:54.629481    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-676955cd56-pc4c2"]
Jul 27 19:13:55.781176 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:13:55.781145    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" path="/var/lib/kubelet/pods/97c19c8b-4f70-4ce3-b68e-dbed634c927d/volumes"
Jul 27 19:14:02.694402 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:02.694364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:02.789143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:02.789111    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:02.884475 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:02.884443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:03.081930 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:03.081835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:06.115128 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:06.115086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:06.212445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:06.212416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:19.952181 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:19.952091    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:39.715408 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:39.715353    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:39.817542 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:39.817507    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:40.410908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.410869    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:40.516629 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.516587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:40.557700 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.557663    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"]
Jul 27 19:14:40.558045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.558026    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" containerName="authorino"
Jul 27 19:14:40.558132 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.558048    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" containerName="authorino"
Jul 27 19:14:40.558182 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.558143    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c19c8b-4f70-4ce3-b68e-dbed634c927d" containerName="authorino"
Jul 27 19:14:40.562502 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.562479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.565115 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.565095    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 19:14:40.566085 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.566054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t9v8k\""
Jul 27 19:14:40.566198 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.566061    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:14:40.566198 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.566162    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 19:14:40.571554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.571517    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"]
Jul 27 19:14:40.733202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.733112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwgs\" (UniqueName: \"kubernetes.io/projected/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-kube-api-access-jbwgs\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.733202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.733157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-openshift-service-ca\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.733202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.733193    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-maas-api-tls\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.834028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.833997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwgs\" (UniqueName: \"kubernetes.io/projected/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-kube-api-access-jbwgs\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.834028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.834034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-openshift-service-ca\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.834326 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.834167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-maas-api-tls\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.834639 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.834615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-openshift-service-ca\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.836647 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.836629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-maas-api-tls\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.842445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.842419    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwgs\" (UniqueName: \"kubernetes.io/projected/d2672ee2-a919-4364-9bb6-9fd2fa0adf71-kube-api-access-jbwgs\") pod \"maas-api-5ccbcc679c-57c62\" (UID: \"d2672ee2-a919-4364-9bb6-9fd2fa0adf71\") " pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.873477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.873443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:40.989230 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:40.989126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:41.015492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:41.015423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"]
Jul 27 19:14:41.018345 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:14:41.018312    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2672ee2_a919_4364_9bb6_9fd2fa0adf71.slice/crio-bd2a90158f471ed157b6816db3e7f78fce4c7857d6fca73419c2ffc16687f3dd WatchSource:0}: Error finding container bd2a90158f471ed157b6816db3e7f78fce4c7857d6fca73419c2ffc16687f3dd: Status 404 returned error can't find the container with id bd2a90158f471ed157b6816db3e7f78fce4c7857d6fca73419c2ffc16687f3dd
Jul 27 19:14:41.085071 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:41.085023    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:41.800452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:41.800409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62" event={"ID":"d2672ee2-a919-4364-9bb6-9fd2fa0adf71","Type":"ContainerStarted","Data":"bd2a90158f471ed157b6816db3e7f78fce4c7857d6fca73419c2ffc16687f3dd"}
Jul 27 19:14:44.837348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:44.837314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62" event={"ID":"d2672ee2-a919-4364-9bb6-9fd2fa0adf71","Type":"ContainerStarted","Data":"a9b7a8f6eacb27e52977a7d87bb829fe67d03da14470bbb0a1107eca590f1b7a"}
Jul 27 19:14:44.837740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:44.837428    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:44.854814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:44.854763    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62" podStartSLOduration=1.992733318 podStartE2EDuration="4.854742979s" totalImagesPullingTime="2.862009661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:14:44.853527026 +0000 UTC m=+565.541391464" watchObservedRunningTime="2026-07-27 19:14:44.854742979 +0000 UTC m=+565.542607432"
Jul 27 19:14:48.334303 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.334237    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": read tcp 10.134.0.2:39960->10.134.0.22:15021: read: connection reset by peer" start-of-body=
Jul 27 19:14:48.334672 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.334346    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": read tcp 10.134.0.2:39960->10.134.0.22:15021: read: connection reset by peer"
Jul 27 19:14:48.856646 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.856613    2560 generic.go:356] "Generic (PLEG): container finished" podID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerID="d52e3b9ae63c35d7495076295d2e72d7c72a6d25eda105d60222b9839896940f" exitCode=0
Jul 27 19:14:48.856814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.856685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" event={"ID":"00878697-68fd-4c92-ad75-7fe7bdb43246","Type":"ContainerDied","Data":"d52e3b9ae63c35d7495076295d2e72d7c72a6d25eda105d60222b9839896940f"}
Jul 27 19:14:48.857072 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.857058    2560 scope.go:117] "RemoveContainer" containerID="d52e3b9ae63c35d7495076295d2e72d7c72a6d25eda105d60222b9839896940f"
Jul 27 19:14:48.858002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.857976    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:14:48.858053 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.858040    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:14:48.858090 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:48.858072    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:14:49.862627 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:49.862592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" event={"ID":"00878697-68fd-4c92-ad75-7fe7bdb43246","Type":"ContainerStarted","Data":"6ccf5ab8d0ec6f575b7b9ef95dcd39463af8c188efa4ca178f24fe04a04ce7bb"}
Jul 27 19:14:50.026008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:50.025950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:14:50.026209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:50.026011    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 27 19:14:50.026209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:50.026065    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 27 19:14:50.847008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:50.846981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ccbcc679c-57c62"
Jul 27 19:14:51.026904 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:51.026864    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 27 19:14:51.027498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:51.027467    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 27 19:14:51.895062 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:51.895026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:51.987367 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:51.987331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:52.026582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:52.026546    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 27 19:14:52.026877 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:52.026848    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 27 19:14:53.026619 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:53.026579    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 27 19:14:53.027273 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:53.027219    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 27 19:14:54.026773 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:54.026728    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-96grz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Jul 27 19:14:54.027183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:54.026799    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz" podUID="00878697-68fd-4c92-ad75-7fe7bdb43246" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Jul 27 19:14:55.029384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:55.029354    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:14:55.029828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:55.029616    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:14:55.030183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:55.030169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-96grz"
Jul 27 19:14:56.357193 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:56.357153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:56.423551 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:56.423522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:14:58.793202 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:14:58.793168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:07.540085 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.540050    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"]
Jul 27 19:15:07.548277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.548236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.552644 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.552615    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:15:07.552805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.552668    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 19:15:07.552960 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.552939    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtjpv\""
Jul 27 19:15:07.553089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.552948    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:15:07.555018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.554994    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"]
Jul 27 19:15:07.599859 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.599816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:07.664395 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.664567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.664567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/68041fe3-2173-4829-983b-7b13a15c7fbe-kube-api-access-4rqnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.664567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.664567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68041fe3-2173-4829-983b-7b13a15c7fbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.664567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.664546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765764 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/68041fe3-2173-4829-983b-7b13a15c7fbe-kube-api-access-4rqnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.765945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.765858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68041fe3-2173-4829-983b-7b13a15c7fbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.766232 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.766197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.766232 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.766212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.766430 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.766290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.768317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.768294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68041fe3-2173-4829-983b-7b13a15c7fbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.768544 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.768527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68041fe3-2173-4829-983b-7b13a15c7fbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.775070 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.775045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqnn\" (UniqueName: \"kubernetes.io/projected/68041fe3-2173-4829-983b-7b13a15c7fbe-kube-api-access-4rqnn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qrk22\" (UID: \"68041fe3-2173-4829-983b-7b13a15c7fbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.860076 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.859984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:07.998572 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:07.998524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"]
Jul 27 19:15:08.000741 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:15:08.000715    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68041fe3_2173_4829_983b_7b13a15c7fbe.slice/crio-f2764c6d76849a63488bed955db6cbaba0cbe427a6f2abd2943a296591734b97 WatchSource:0}: Error finding container f2764c6d76849a63488bed955db6cbaba0cbe427a6f2abd2943a296591734b97: Status 404 returned error can't find the container with id f2764c6d76849a63488bed955db6cbaba0cbe427a6f2abd2943a296591734b97
Jul 27 19:15:08.944682 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:08.944643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22" event={"ID":"68041fe3-2173-4829-983b-7b13a15c7fbe","Type":"ContainerStarted","Data":"f2764c6d76849a63488bed955db6cbaba0cbe427a6f2abd2943a296591734b97"}
Jul 27 19:15:09.950705 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:09.950665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22" event={"ID":"68041fe3-2173-4829-983b-7b13a15c7fbe","Type":"ContainerStarted","Data":"384d290f5304b2fdda460338fecf28661c128bbf80aa861f25728dce3e5088ac"}
Jul 27 19:15:09.972165 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:09.972108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22" podStartSLOduration=1.924409057 podStartE2EDuration="2.972091177s" totalImagesPullingTime="1.04768212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:09.970455879 +0000 UTC m=+590.658320342" watchObservedRunningTime="2026-07-27 19:15:09.972091177 +0000 UTC m=+590.659955656"
Jul 27 19:15:15.948902 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:15.948860    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"]
Jul 27 19:15:15.954105 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:15.954076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:15.956481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:15.956459    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 19:15:15.959684 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:15.959661    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"]
Jul 27 19:15:15.974008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:15.973964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:16.039293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.039464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bl5\" (UniqueName: \"kubernetes.io/projected/4f4decd2-4963-4997-9105-90b3968f1d13-kube-api-access-s2bl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.039464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.039464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.039464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.039464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.039458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4decd2-4963-4997-9105-90b3968f1d13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140039 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140039 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4decd2-4963-4997-9105-90b3968f1d13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bl5\" (UniqueName: \"kubernetes.io/projected/4f4decd2-4963-4997-9105-90b3968f1d13-kube-api-access-s2bl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140635 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.140635 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.140617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.142434 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.142410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f4decd2-4963-4997-9105-90b3968f1d13-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.142717 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.142700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f4decd2-4963-4997-9105-90b3968f1d13-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.149010 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.148985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bl5\" (UniqueName: \"kubernetes.io/projected/4f4decd2-4963-4997-9105-90b3968f1d13-kube-api-access-s2bl5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bd59\" (UID: \"4f4decd2-4963-4997-9105-90b3968f1d13\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.266211 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.266094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:16.402129 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.402107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"]
Jul 27 19:15:16.404594 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:15:16.404564    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4decd2_4963_4997_9105_90b3968f1d13.slice/crio-65c377ffb398deecd5e5c44f0cb774b14752f098fbbc878843ca04d098d6f5b2 WatchSource:0}: Error finding container 65c377ffb398deecd5e5c44f0cb774b14752f098fbbc878843ca04d098d6f5b2: Status 404 returned error can't find the container with id 65c377ffb398deecd5e5c44f0cb774b14752f098fbbc878843ca04d098d6f5b2
Jul 27 19:15:16.980760 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.980671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59" event={"ID":"4f4decd2-4963-4997-9105-90b3968f1d13","Type":"ContainerStarted","Data":"41842fb4330ad38d0f83aa5b7d579269a173743dad6a92dae4e0fd0df7ba755d"}
Jul 27 19:15:16.980760 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:16.980721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59" event={"ID":"4f4decd2-4963-4997-9105-90b3968f1d13","Type":"ContainerStarted","Data":"65c377ffb398deecd5e5c44f0cb774b14752f098fbbc878843ca04d098d6f5b2"}
Jul 27 19:15:17.001137 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:17.001083    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59" podStartSLOduration=1.7635737759999999 podStartE2EDuration="2.001066744s" totalImagesPullingTime="237.492968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:16.999578053 +0000 UTC m=+597.687442492" watchObservedRunningTime="2026-07-27 19:15:17.001066744 +0000 UTC m=+597.688931183"
Jul 27 19:15:17.860963 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:17.860925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:17.861174 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:17.861002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:17.872627 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:17.872599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:17.995807 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:17.995780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qrk22"
Jul 27 19:15:26.267285 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:26.267227    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:26.267711 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:26.267313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:26.279445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:26.279413    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:27.034036 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:27.034007    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bd59"
Jul 27 19:15:27.692991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:27.692949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:33.085299 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:33.085243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:15:38.981491 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:15:38.981455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:06.532771 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:06.532737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:06.585109 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:06.585075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:19.980263 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:19.980216    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:20.038077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:20.038044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:35.381451 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:35.381408    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:16:40.038386 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:16:40.038349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:01.335361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:01.335325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:01.842642 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:01.842580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:16.639293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.639203    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8696b8445c-j2rmp"]
Jul 27 19:17:16.642399 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.642382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.645288 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.645271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 19:17:16.646469 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.646451    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n8q5m\""
Jul 27 19:17:16.651960 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.651938    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8696b8445c-j2rmp"]
Jul 27 19:17:16.774972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.774929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vgp\" (UniqueName: \"kubernetes.io/projected/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-kube-api-access-f7vgp\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.775148 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.774980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-tls-cert\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.876415 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.876374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vgp\" (UniqueName: \"kubernetes.io/projected/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-kube-api-access-f7vgp\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.876583 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.876431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-tls-cert\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.879266 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.879220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-tls-cert\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.887611 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.887586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vgp\" (UniqueName: \"kubernetes.io/projected/b9ffeb85-c3dc-4944-bb29-c1ddddd7a823-kube-api-access-f7vgp\") pod \"authorino-8696b8445c-j2rmp\" (UID: \"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823\") " pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:16.951769 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:16.951693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8696b8445c-j2rmp"
Jul 27 19:17:17.099084 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:17.099056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8696b8445c-j2rmp"]
Jul 27 19:17:17.100628 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:17:17.100602    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9ffeb85_c3dc_4944_bb29_c1ddddd7a823.slice/crio-c25700a0fd60337373770f06047d31a7acc685a57bc00dd3a936e9d1a7f62a47 WatchSource:0}: Error finding container c25700a0fd60337373770f06047d31a7acc685a57bc00dd3a936e9d1a7f62a47: Status 404 returned error can't find the container with id c25700a0fd60337373770f06047d31a7acc685a57bc00dd3a936e9d1a7f62a47
Jul 27 19:17:17.101893 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:17.101877    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:17:17.118486 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:17.118448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:17.221735 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:17.221649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:17.474131 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:17.474062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8696b8445c-j2rmp" event={"ID":"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823","Type":"ContainerStarted","Data":"c25700a0fd60337373770f06047d31a7acc685a57bc00dd3a936e9d1a7f62a47"}
Jul 27 19:17:18.364320 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:18.364275    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:18.468480 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:18.468446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:18.479724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:18.479688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8696b8445c-j2rmp" event={"ID":"b9ffeb85-c3dc-4944-bb29-c1ddddd7a823","Type":"ContainerStarted","Data":"1ff5c4898a3e625b1423229ff061d54f98a08f395333037ecc9bf0bfd67ef938"}
Jul 27 19:17:18.511465 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:18.511399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8696b8445c-j2rmp" podStartSLOduration=2.169900246 podStartE2EDuration="2.511375737s" totalImagesPullingTime="341.475491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:17:18.510974347 +0000 UTC m=+719.198838787" watchObservedRunningTime="2026-07-27 19:17:18.511375737 +0000 UTC m=+719.199240178"
Jul 27 19:17:40.100047 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:40.100010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:40.201792 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:40.201760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:53.696681 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:53.696643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:17:53.797871 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:17:53.797830    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:24.182689 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:19:24.182652    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:19:25.434618 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:19:25.434549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:06.425509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:06.425468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:06.513575 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:06.513524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:06.648371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:06.648341    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:12.824847 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:12.824745    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:12.942105 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:12.942071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:13.079595 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:13.079499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:13.176645 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:13.176604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:19.029333 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:19.029301    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:20:19.118168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:20:19.118131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:21:45.500442 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:21:45.500363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:22:02.320711 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:22:02.320677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:38.359175 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:38.359139    2560 generic.go:356] "Generic (PLEG): container finished" podID="99130f6b-ee23-4c2a-8eb9-349f0d2f5d61" containerID="ec1594ee8b5afd84663cbb9848e1a6365c0271a188f8b5921e07c0c6d8ca5edf" exitCode=1
Jul 27 19:24:38.359580 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:38.359214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2" event={"ID":"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61","Type":"ContainerDied","Data":"ec1594ee8b5afd84663cbb9848e1a6365c0271a188f8b5921e07c0c6d8ca5edf"}
Jul 27 19:24:38.359580 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:38.359553    2560 scope.go:117] "RemoveContainer" containerID="ec1594ee8b5afd84663cbb9848e1a6365c0271a188f8b5921e07c0c6d8ca5edf"
Jul 27 19:24:39.365087 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:39.365049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2" event={"ID":"99130f6b-ee23-4c2a-8eb9-349f0d2f5d61","Type":"ContainerStarted","Data":"4f90b5dec41766a8a5965060204037d85e5ae990ec57a643cc8edac470df291e"}
Jul 27 19:24:39.365492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:39.365269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:24:50.372119 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:50.372091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g6jc2"
Jul 27 19:24:54.946712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:54.946669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:24:55.002502 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:24:55.002471    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:06.906419 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:27:06.906379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:48.059272 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:27:48.059204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:27:52.896747 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:27:52.896702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:08.359638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:28:08.359604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:55.592265 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:28:55.592227    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:28:57.012992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:28:57.012956    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:00.034797 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:29:00.034757    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:29:00.138126 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:29:00.138092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:25.723022 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:31:25.722970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:25.777930 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:31:25.777884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:31:59.568590 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:31:59.568557    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:19.066214 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:19.066129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:22.509731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:22.509693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:22.616990 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:22.616924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:23.007807 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:23.007776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:28.826986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:28.826946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:28.927696 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:28.927668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:29.083868 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.083798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:29.390233 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.390202    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:32:29.393486 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.393466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.395778 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.395760    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0b1393fc-openshift-default-dockercfg-46n8h\""
Jul 27 19:32:29.415978 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.415956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:32:29.425728 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.425703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:29.517427 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517427 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tfmp\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.517939 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.517689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.618828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.618790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.618828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.618836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.618854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.618880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tfmp\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619607 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619607 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619733 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.619733 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.619634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.621459 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.621436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.622094 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.622073    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.627075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.627054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.627300 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.627280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tfmp\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp\") pod \"e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") " pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.635986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.635958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:29.703674 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.703604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:29.864622 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.864592    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:32:29.867922 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:32:29.867891    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2fda94_ebe7_402f_90fc_7487d9c06763.slice/crio-7ad689fd969286464aabf90f2ab8516327149f41ff1c5cc839ee14dfd09d8e4c WatchSource:0}: Error finding container 7ad689fd969286464aabf90f2ab8516327149f41ff1c5cc839ee14dfd09d8e4c: Status 404 returned error can't find the container with id 7ad689fd969286464aabf90f2ab8516327149f41ff1c5cc839ee14dfd09d8e4c
Jul 27 19:32:29.870654 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.870623    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:29.870737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.870686    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:29.870737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:29.870712    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:30.360728 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:30.360694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerStarted","Data":"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"}
Jul 27 19:32:30.360901 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:30.360741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerStarted","Data":"7ad689fd969286464aabf90f2ab8516327149f41ff1c5cc839ee14dfd09d8e4c"}
Jul 27 19:32:30.384901 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:30.383487    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podStartSLOduration=1.383466416 podStartE2EDuration="1.383466416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:30.380431188 +0000 UTC m=+1631.068295628" watchObservedRunningTime="2026-07-27 19:32:30.383466416 +0000 UTC m=+1631.071330856"
Jul 27 19:32:30.704593 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:30.704559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:30.709168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:30.709146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:31.364862 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:31.364826    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:31.365750 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:31.365731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:31.741625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:31.741593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:31.878170 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:31.878139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:31.982791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:31.982756    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:32.081652 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:32.081571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:32.477885 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:32.477852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:32.575341 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:32.575314    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:32:46.366288 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.366162    2560 patch_prober.go:28] interesting pod/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 27 19:32:46.366288 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.366240    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 27 19:32:46.438258 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.438211    2560 generic.go:356] "Generic (PLEG): container finished" podID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerID="8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd" exitCode=0
Jul 27 19:32:46.438427 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.438285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerDied","Data":"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"}
Jul 27 19:32:46.438741 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.438722    2560 scope.go:117] "RemoveContainer" containerID="8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"
Jul 27 19:32:46.439852 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.439826    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:46.439909 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.439893    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:46.439941 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:46.439932    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:32:47.444268 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:47.444220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerStarted","Data":"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"}
Jul 27 19:32:47.704795 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:47.704709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:47.704952 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:47.704932    2560 patch_prober.go:28] interesting pod/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 27 19:32:47.704997 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:47.704980    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 27 19:32:48.704653 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:48.704617    2560 patch_prober.go:28] interesting pod/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 27 19:32:48.705085 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:48.704678    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 27 19:32:49.704429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:49.704392    2560 patch_prober.go:28] interesting pod/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 27 19:32:49.704613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:49.704460    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 27 19:32:50.704190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:50.704159    2560 patch_prober.go:28] interesting pod/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 27 19:32:50.704622 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:50.704228    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 27 19:32:51.708200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:51.708169    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:51.708615 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:51.708520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:32:51.709147 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:32:51.709130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:33:07.936338 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:07.936305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.005859 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.005828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.075561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.075530    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.130639 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.130607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.239479 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.239399    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:33:08.239641 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.239613    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy" containerID="cri-o://f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f" gracePeriod=30
Jul 27 19:33:08.262042 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.261999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.518358 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.518276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.773170 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.773097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:08.868665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:08.868634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:09.014970 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:09.014935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:09.333324 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:09.333294    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:09.596209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:09.596121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:13.486916 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.486893    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:33:13.553390 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.553304    2560 generic.go:356] "Generic (PLEG): container finished" podID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerID="f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f" exitCode=0
Jul 27 19:33:13.553390 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.553368    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"
Jul 27 19:33:13.553576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.553385    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerDied","Data":"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"}
Jul 27 19:33:13.553576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.553462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs" event={"ID":"0b2fda94-ebe7-402f-90fc-7487d9c06763","Type":"ContainerDied","Data":"7ad689fd969286464aabf90f2ab8516327149f41ff1c5cc839ee14dfd09d8e4c"}
Jul 27 19:33:13.553576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.553488    2560 scope.go:117] "RemoveContainer" containerID="f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"
Jul 27 19:33:13.561767 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.561749    2560 scope.go:117] "RemoveContainer" containerID="8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"
Jul 27 19:33:13.569131 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.569113    2560 scope.go:117] "RemoveContainer" containerID="f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"
Jul 27 19:33:13.569391 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:33:13.569372    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f\": container with ID starting with f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f not found: ID does not exist" containerID="f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"
Jul 27 19:33:13.569440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.569399    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f"} err="failed to get container status \"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f\": rpc error: code = NotFound desc = could not find container \"f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f\": container with ID starting with f3afc27a06fe70c4e2cc6ee4133c1c01b6be087c46bcd38de22eb305c2be933f not found: ID does not exist"
Jul 27 19:33:13.569440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.569418    2560 scope.go:117] "RemoveContainer" containerID="8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"
Jul 27 19:33:13.569682 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:33:13.569666    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd\": container with ID starting with 8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd not found: ID does not exist" containerID="8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"
Jul 27 19:33:13.569721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.569688    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd"} err="failed to get container status \"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd\": rpc error: code = NotFound desc = could not find container \"8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd\": container with ID starting with 8cdb8fe1167136d5e48539f56c17db319f419a154ec2e84605f9bfbdb06d27cd not found: ID does not exist"
Jul 27 19:33:13.615215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615218    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615341    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615412    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615431    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tfmp\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615467    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert\") pod \"0b2fda94-ebe7-402f-90fc-7487d9c06763\" (UID: \"0b2fda94-ebe7-402f-90fc-7487d9c06763\") "
Jul 27 19:33:13.615498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615472    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:13.615876 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615723    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.615876 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615788    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:13.616143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:13.616143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.615989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:13.616463 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.616433    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:13.617805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.617771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:33:13.617892 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.617776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:13.617892 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.617772    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:13.617892 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.617779    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp" (OuterVolumeSpecName: "kube-api-access-9tfmp") pod "0b2fda94-ebe7-402f-90fc-7487d9c06763" (UID: "0b2fda94-ebe7-402f-90fc-7487d9c06763"). InnerVolumeSpecName "kube-api-access-9tfmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:13.716184 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716151    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716184 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716179    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716184 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716188    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716196    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tfmp\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-kube-api-access-9tfmp\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716205    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b2fda94-ebe7-402f-90fc-7487d9c06763-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716214    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716220    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.716424 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.716227    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b2fda94-ebe7-402f-90fc-7487d9c06763-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:13.869686 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.869655    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:33:13.873357 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:13.873334    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0b1393fc-openshift-default-5478b484f4-cvmfs"]
Jul 27 19:33:14.033037 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.032988    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:14.107578 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.107548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:14.108041 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.108017    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:14.108041 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.108038    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:14.108178 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.108147    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:14.112527 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.112511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.115039 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.115021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-00691797-serving-cert\""
Jul 27 19:33:14.123621 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.123599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:14.143623 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.143594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:14.220986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.220959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.221176 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.220994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.221176 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.221014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfrjl\" (UniqueName: \"kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.322281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.322224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.322281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.322283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.322520 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.322309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfrjl\" (UniqueName: \"kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.322520 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:33:14.322432    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-serving-cert: secret "maas-api-e2e-migrate-00691797-serving-cert" not found
Jul 27 19:33:14.322623 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:33:14.322527    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls podName:334d1684-a5eb-4516-a318-6988daaaf9ae nodeName:}" failed. No retries permitted until 2026-07-27 19:33:14.822501626 +0000 UTC m=+1675.510366065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls") pod "maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" (UID: "334d1684-a5eb-4516-a318-6988daaaf9ae") : secret "maas-api-e2e-migrate-00691797-serving-cert" not found
Jul 27 19:33:14.322900 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.322881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.334548 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.334524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfrjl\" (UniqueName: \"kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.728079 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.728048    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:14.827894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.827857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.829139 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.829112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:14.830514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.830495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") pod \"maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:14.910615 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:14.910550    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:15.024769 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.024671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:15.154685 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.154663    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:15.156547 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:33:15.156521    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334d1684_a5eb_4516_a318_6988daaaf9ae.slice/crio-3c0df6e26eafad032e1844b0a82cf33837e7641a0148876500bd52346bc99c3f WatchSource:0}: Error finding container 3c0df6e26eafad032e1844b0a82cf33837e7641a0148876500bd52346bc99c3f: Status 404 returned error can't find the container with id 3c0df6e26eafad032e1844b0a82cf33837e7641a0148876500bd52346bc99c3f
Jul 27 19:33:15.157926 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.157907    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:33:15.514873 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.514841    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:15.564636 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.564602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" event={"ID":"334d1684-a5eb-4516-a318-6988daaaf9ae","Type":"ContainerStarted","Data":"3c0df6e26eafad032e1844b0a82cf33837e7641a0148876500bd52346bc99c3f"}
Jul 27 19:33:15.780992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:15.780914    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" path="/var/lib/kubelet/pods/0b2fda94-ebe7-402f-90fc-7487d9c06763/volumes"
Jul 27 19:33:16.570823 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:16.570790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" event={"ID":"334d1684-a5eb-4516-a318-6988daaaf9ae","Type":"ContainerStarted","Data":"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"}
Jul 27 19:33:16.571000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:16.570866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:16.587053 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:16.587007    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" podStartSLOduration=1.892355091 podStartE2EDuration="2.586994126s" totalImagesPullingTime="694.639035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:16.585781996 +0000 UTC m=+1677.273646448" watchObservedRunningTime="2026-07-27 19:33:16.586994126 +0000 UTC m=+1677.274858583"
Jul 27 19:33:22.580354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:22.580326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:54.640979 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.640896    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:54.641500 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.641218    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" podUID="334d1684-a5eb-4516-a318-6988daaaf9ae" containerName="maas-api" containerID="cri-o://4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc" gracePeriod=30
Jul 27 19:33:54.665241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.665218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:54.741491 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.741457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:54.805447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.805418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:54.887787 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.887760    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:54.907106 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.907021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:54.972060 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.972033    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") pod \"334d1684-a5eb-4516-a318-6988daaaf9ae\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") "
Jul 27 19:33:54.972223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.972068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfrjl\" (UniqueName: \"kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl\") pod \"334d1684-a5eb-4516-a318-6988daaaf9ae\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") "
Jul 27 19:33:54.972223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.972098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca\") pod \"334d1684-a5eb-4516-a318-6988daaaf9ae\" (UID: \"334d1684-a5eb-4516-a318-6988daaaf9ae\") "
Jul 27 19:33:54.972695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.972648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "334d1684-a5eb-4516-a318-6988daaaf9ae" (UID: "334d1684-a5eb-4516-a318-6988daaaf9ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:33:54.976174 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.976144    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "334d1684-a5eb-4516-a318-6988daaaf9ae" (UID: "334d1684-a5eb-4516-a318-6988daaaf9ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:33:54.976308 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:54.976185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl" (OuterVolumeSpecName: "kube-api-access-gfrjl") pod "334d1684-a5eb-4516-a318-6988daaaf9ae" (UID: "334d1684-a5eb-4516-a318-6988daaaf9ae"). InnerVolumeSpecName "kube-api-access-gfrjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:55.015042 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.015012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:55.072928 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.072903    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334d1684-a5eb-4516-a318-6988daaaf9ae-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.072928 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.072923    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfrjl\" (UniqueName: \"kubernetes.io/projected/334d1684-a5eb-4516-a318-6988daaaf9ae-kube-api-access-gfrjl\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.073077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.072934    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334d1684-a5eb-4516-a318-6988daaaf9ae-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:33:55.260031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.259943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:55.523306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.523206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:55.731746 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.731707    2560 generic.go:356] "Generic (PLEG): container finished" podID="334d1684-a5eb-4516-a318-6988daaaf9ae" containerID="4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc" exitCode=0
Jul 27 19:33:55.732136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.731755    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"
Jul 27 19:33:55.732136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.731793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" event={"ID":"334d1684-a5eb-4516-a318-6988daaaf9ae","Type":"ContainerDied","Data":"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"}
Jul 27 19:33:55.732136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.731846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk" event={"ID":"334d1684-a5eb-4516-a318-6988daaaf9ae","Type":"ContainerDied","Data":"3c0df6e26eafad032e1844b0a82cf33837e7641a0148876500bd52346bc99c3f"}
Jul 27 19:33:55.732136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.731869    2560 scope.go:117] "RemoveContainer" containerID="4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"
Jul 27 19:33:55.740950 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.740932    2560 scope.go:117] "RemoveContainer" containerID="4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"
Jul 27 19:33:55.741211 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:33:55.741192    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc\": container with ID starting with 4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc not found: ID does not exist" containerID="4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"
Jul 27 19:33:55.741303 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.741219    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc"} err="failed to get container status \"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc\": rpc error: code = NotFound desc = could not find container \"4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc\": container with ID starting with 4dd6bbe0b325e3069b16fd3f0f14b34084d89d71c4bdc54b1fb62a61a11fdafc not found: ID does not exist"
Jul 27 19:33:55.752458 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.752433    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:55.758341 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.758321    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-00691797-7c6645f7dd-97pzk"]
Jul 27 19:33:55.781018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.780954    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="334d1684-a5eb-4516-a318-6988daaaf9ae" path="/var/lib/kubelet/pods/334d1684-a5eb-4516-a318-6988daaaf9ae/volumes"
Jul 27 19:33:55.838541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838512    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:33:55.838813 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838801    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334d1684-a5eb-4516-a318-6988daaaf9ae" containerName="maas-api"
Jul 27 19:33:55.838887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838814    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="334d1684-a5eb-4516-a318-6988daaaf9ae" containerName="maas-api"
Jul 27 19:33:55.838887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838832    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:55.838887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838838    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:55.838887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838879    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="334d1684-a5eb-4516-a318-6988daaaf9ae" containerName="maas-api"
Jul 27 19:33:55.838887 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.838887    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2fda94-ebe7-402f-90fc-7487d9c06763" containerName="istio-proxy"
Jul 27 19:33:55.843136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.843119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.845478 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.845457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bb026c71-openshift-default-dockercfg-zzzpc\""
Jul 27 19:33:55.853957 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.853933    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:33:55.869031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.869007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:55.980421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980716 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc2np\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980783 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:55.980783 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:55.980771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081380 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081380 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc2np\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081587 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081587 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081587 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.081881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.082031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.082031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.082031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.081965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.082341 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.082294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.082698 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.082671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.084042 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.084020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.084309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.084289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.089861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.089837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.090020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.090002    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc2np\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np\") pod \"e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") " pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.153457 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.153434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:56.191126 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.191097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:56.293651 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.293629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:33:56.295458 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:33:56.295429    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c84f56c_18b7_4c68_90f3_285a345ebf04.slice/crio-24871eb67cc0a49efef825574ab70fc5322b86245004ad907f35479f60bb0ad3 WatchSource:0}: Error finding container 24871eb67cc0a49efef825574ab70fc5322b86245004ad907f35479f60bb0ad3: Status 404 returned error can't find the container with id 24871eb67cc0a49efef825574ab70fc5322b86245004ad907f35479f60bb0ad3
Jul 27 19:33:56.297752 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.297721    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:56.297833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.297785    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:56.297833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.297811    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:33:56.738208 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.738172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerStarted","Data":"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"}
Jul 27 19:33:56.738673 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.738228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerStarted","Data":"24871eb67cc0a49efef825574ab70fc5322b86245004ad907f35479f60bb0ad3"}
Jul 27 19:33:56.758335 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:56.758294    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podStartSLOduration=1.758279803 podStartE2EDuration="1.758279803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:56.75756003 +0000 UTC m=+1717.445424469" watchObservedRunningTime="2026-07-27 19:33:56.758279803 +0000 UTC m=+1717.446144242"
Jul 27 19:33:57.154116 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:57.154083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:57.158977 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:57.158951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:57.744736 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:57.744708    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:57.745728 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:57.745706    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:33:58.114860 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.114784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.193364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.193335    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.198447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.198422    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:33:58.201679 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.201660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.204171 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.204151    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bb026c71-serving-cert\""
Jul 27 19:33:58.216180 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.216160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:33:58.275675 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.275646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.306863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.306837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.307027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.306874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.307027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.306898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9mnz\" (UniqueName: \"kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.393908 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.393874    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.408080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.408058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.408161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.408092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.408161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.408115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9mnz\" (UniqueName: \"kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.408748 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.408726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.410601 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.410583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.416392 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.416370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9mnz\" (UniqueName: \"kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz\") pod \"maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.514500 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.514461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:58.649365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.649338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:33:58.652090 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:33:58.652054    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac3f02c_9ad7_4f01_a418_e87f59cffc02.slice/crio-4c98470129e50c5fe01a5b6191f2f810bda01b40410a9f8d308f0524e1e9ef2b WatchSource:0}: Error finding container 4c98470129e50c5fe01a5b6191f2f810bda01b40410a9f8d308f0524e1e9ef2b: Status 404 returned error can't find the container with id 4c98470129e50c5fe01a5b6191f2f810bda01b40410a9f8d308f0524e1e9ef2b
Jul 27 19:33:58.729452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.729398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:58.753024 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.752984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" event={"ID":"8ac3f02c-9ad7-4f01-a418-e87f59cffc02","Type":"ContainerStarted","Data":"4c98470129e50c5fe01a5b6191f2f810bda01b40410a9f8d308f0524e1e9ef2b"}
Jul 27 19:33:58.824976 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:58.824939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:59.749986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:59.749951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:33:59.759548 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:59.759520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" event={"ID":"8ac3f02c-9ad7-4f01-a418-e87f59cffc02","Type":"ContainerStarted","Data":"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"}
Jul 27 19:33:59.759917 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:59.759677    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:33:59.778782 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:33:59.778736    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" podStartSLOduration=1.421934497 podStartE2EDuration="1.778721766s" totalImagesPullingTime="356.787269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:59.778140074 +0000 UTC m=+1720.466004515" watchObservedRunningTime="2026-07-27 19:33:59.778721766 +0000 UTC m=+1720.466586206"
Jul 27 19:34:05.770464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:05.770434    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:34:12.746358 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.746319    2560 patch_prober.go:28] interesting pod/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 27 19:34:12.746766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.746394    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 27 19:34:12.825005 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.824972    2560 generic.go:356] "Generic (PLEG): container finished" podID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerID="a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742" exitCode=0
Jul 27 19:34:12.825141 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.825047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerDied","Data":"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"}
Jul 27 19:34:12.825496 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.825481    2560 scope.go:117] "RemoveContainer" containerID="a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"
Jul 27 19:34:12.826468 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.826441    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:12.826538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.826507    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:12.826574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:12.826541    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:34:13.833620 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:13.833585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerStarted","Data":"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"}
Jul 27 19:34:14.154636 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:14.154602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:14.154879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:14.154856    2560 patch_prober.go:28] interesting pod/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 27 19:34:14.154959 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:14.154912    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 27 19:34:15.154320 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:15.154284    2560 patch_prober.go:28] interesting pod/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 27 19:34:15.154700 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:15.154340    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 27 19:34:16.154498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:16.154464    2560 patch_prober.go:28] interesting pod/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 27 19:34:16.154886 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:16.154519    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 27 19:34:17.153995 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:17.153954    2560 patch_prober.go:28] interesting pod/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 27 19:34:17.154178 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:17.154024    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 27 19:34:18.157390 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:18.157354    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:18.157750 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:18.157701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:18.158293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:18.158279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:34.466385 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.466337    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:34:34.466949 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.466581    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" podUID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" containerName="maas-api" containerID="cri-o://a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054" gracePeriod=30
Jul 27 19:34:34.491806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.491783    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:34.592173 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.592142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:34.667193 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.667164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:34.713471 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.713446    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:34:34.727012 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.726924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:34.904501 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.904472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9mnz\" (UniqueName: \"kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz\") pod \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") "
Jul 27 19:34:34.904663 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.904533    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca\") pod \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") "
Jul 27 19:34:34.904663 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.904561    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls\") pod \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\" (UID: \"8ac3f02c-9ad7-4f01-a418-e87f59cffc02\") "
Jul 27 19:34:34.904910 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.904889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ac3f02c-9ad7-4f01-a418-e87f59cffc02" (UID: "8ac3f02c-9ad7-4f01-a418-e87f59cffc02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:34.906645 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.906618    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz" (OuterVolumeSpecName: "kube-api-access-g9mnz") pod "8ac3f02c-9ad7-4f01-a418-e87f59cffc02" (UID: "8ac3f02c-9ad7-4f01-a418-e87f59cffc02"). InnerVolumeSpecName "kube-api-access-g9mnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:34.906754 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.906700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ac3f02c-9ad7-4f01-a418-e87f59cffc02" (UID: "8ac3f02c-9ad7-4f01-a418-e87f59cffc02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:34:34.924684 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.924662    2560 generic.go:356] "Generic (PLEG): container finished" podID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" containerID="a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054" exitCode=0
Jul 27 19:34:34.924794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.924706    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"
Jul 27 19:34:34.924794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.924736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" event={"ID":"8ac3f02c-9ad7-4f01-a418-e87f59cffc02","Type":"ContainerDied","Data":"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"}
Jul 27 19:34:34.924794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.924779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx" event={"ID":"8ac3f02c-9ad7-4f01-a418-e87f59cffc02","Type":"ContainerDied","Data":"4c98470129e50c5fe01a5b6191f2f810bda01b40410a9f8d308f0524e1e9ef2b"}
Jul 27 19:34:34.924951 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.924799    2560 scope.go:117] "RemoveContainer" containerID="a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"
Jul 27 19:34:34.933701 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.933678    2560 scope.go:117] "RemoveContainer" containerID="a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"
Jul 27 19:34:34.933938 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:34:34.933919    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054\": container with ID starting with a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054 not found: ID does not exist" containerID="a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"
Jul 27 19:34:34.933988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.933945    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054"} err="failed to get container status \"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054\": rpc error: code = NotFound desc = could not find container \"a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054\": container with ID starting with a94942b8edcaec61eb4f6f2aaf0dedfe5999baa84e4b257f8aba9223ca80d054 not found: ID does not exist"
Jul 27 19:34:34.946748 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.946720    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:34:34.951830 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:34.951810    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bb026c71-75cb8c4b9f-qrvpx"]
Jul 27 19:34:35.005325 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.005269    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:35.005325 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.005290    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:35.005325 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.005299    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9mnz\" (UniqueName: \"kubernetes.io/projected/8ac3f02c-9ad7-4f01-a418-e87f59cffc02-kube-api-access-g9mnz\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:35.780996 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.780961    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" path="/var/lib/kubelet/pods/8ac3f02c-9ad7-4f01-a418-e87f59cffc02/volumes"
Jul 27 19:34:35.970611 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.970573    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:34:35.970861 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.970824    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy" containerID="cri-o://efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4" gracePeriod=30
Jul 27 19:34:35.991853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:35.991826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:36.252673 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:36.252642    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:36.503530 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:36.503459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:36.830629 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:36.830542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:37.079056 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:37.079019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:39.506598 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.506563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:39.594105 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.594073    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:34:39.594505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.594486    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" containerName="maas-api"
Jul 27 19:34:39.594604 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.594507    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" containerName="maas-api"
Jul 27 19:34:39.594656 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.594618    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac3f02c-9ad7-4f01-a418-e87f59cffc02" containerName="maas-api"
Jul 27 19:34:39.596021 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.595997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:39.599043 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.599027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.602277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.602237    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5dae47b4-serving-cert\""
Jul 27 19:34:39.609185 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.609162    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:34:39.640177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.640108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.640177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.640158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.640340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.640237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9m9\" (UniqueName: \"kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.680297 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.680267    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:39.741227 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.741203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.741349 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.741243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.741349 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.741305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9m9\" (UniqueName: \"kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.741883 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.741865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.743683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.743664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.752110 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.752083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9m9\" (UniqueName: \"kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9\") pod \"maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:39.800308 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.800230    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:39.910060 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:39.909975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:40.064731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.064708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:34:40.067410 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:34:40.067382    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded55829c_94aa_408a_9196_25ae76233b39.slice/crio-d3ebf6b2a36ffa671dde06b5000f814a0d843e956be5903a2003a9eab6a30e57 WatchSource:0}: Error finding container d3ebf6b2a36ffa671dde06b5000f814a0d843e956be5903a2003a9eab6a30e57: Status 404 returned error can't find the container with id d3ebf6b2a36ffa671dde06b5000f814a0d843e956be5903a2003a9eab6a30e57
Jul 27 19:34:40.266907 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.266825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:40.368391 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.368356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:34:40.952025 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.951988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" event={"ID":"ed55829c-94aa-408a-9196-25ae76233b39","Type":"ContainerStarted","Data":"b644c3554913647d8500612e18e94e3ecfde0f1f876911e58bbe49b9d7f96656"}
Jul 27 19:34:40.952429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.952049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" event={"ID":"ed55829c-94aa-408a-9196-25ae76233b39","Type":"ContainerStarted","Data":"d3ebf6b2a36ffa671dde06b5000f814a0d843e956be5903a2003a9eab6a30e57"}
Jul 27 19:34:40.952429 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.952184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:34:40.968203 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:40.968154    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" podStartSLOduration=1.4896853380000001 podStartE2EDuration="1.968141433s" totalImagesPullingTime="478.456095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:40.966595605 +0000 UTC m=+1761.654460043" watchObservedRunningTime="2026-07-27 19:34:40.968141433 +0000 UTC m=+1761.656005870"
Jul 27 19:34:41.217820 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.217798    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:41.254124 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254102    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254130    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc2np\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254281    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254301    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254393    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data\") pod \"6c84f56c-18b7-4c68-90f3-285a345ebf04\" (UID: \"6c84f56c-18b7-4c68-90f3-285a345ebf04\") "
Jul 27 19:34:41.254562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254420    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:41.254562 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:41.254863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:41.254863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254741    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.254863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254759    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.254863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254773    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.254863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.254816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:41.255689 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.255660    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:41.256440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.256418    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:41.256637 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.256613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:41.256637 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.256627    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np" (OuterVolumeSpecName: "kube-api-access-bc2np") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "kube-api-access-bc2np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:41.256851 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.256831    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c84f56c-18b7-4c68-90f3-285a345ebf04" (UID: "6c84f56c-18b7-4c68-90f3-285a345ebf04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:34:41.355973 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.355939    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.355973 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.355969    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.355973 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.355979    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c84f56c-18b7-4c68-90f3-285a345ebf04-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.356183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.355991    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.356183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.356003    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c84f56c-18b7-4c68-90f3-285a345ebf04-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.356183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.356016    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc2np\" (UniqueName: \"kubernetes.io/projected/6c84f56c-18b7-4c68-90f3-285a345ebf04-kube-api-access-bc2np\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:34:41.957304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.957271    2560 generic.go:356] "Generic (PLEG): container finished" podID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerID="efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4" exitCode=0
Jul 27 19:34:41.957775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.957318    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"
Jul 27 19:34:41.957775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.957333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerDied","Data":"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"}
Jul 27 19:34:41.957775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.957391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8" event={"ID":"6c84f56c-18b7-4c68-90f3-285a345ebf04","Type":"ContainerDied","Data":"24871eb67cc0a49efef825574ab70fc5322b86245004ad907f35479f60bb0ad3"}
Jul 27 19:34:41.957775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.957423    2560 scope.go:117] "RemoveContainer" containerID="efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"
Jul 27 19:34:41.965688 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.965673    2560 scope.go:117] "RemoveContainer" containerID="a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"
Jul 27 19:34:41.972984 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.972968    2560 scope.go:117] "RemoveContainer" containerID="efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"
Jul 27 19:34:41.973224 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:34:41.973206    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4\": container with ID starting with efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4 not found: ID does not exist" containerID="efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"
Jul 27 19:34:41.973294 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.973233    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4"} err="failed to get container status \"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4\": rpc error: code = NotFound desc = could not find container \"efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4\": container with ID starting with efad80f93717d233cd44932bd627aceb97965e36e4b9c87ec6a89647bbc325b4 not found: ID does not exist"
Jul 27 19:34:41.973294 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.973269    2560 scope.go:117] "RemoveContainer" containerID="a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"
Jul 27 19:34:41.973522 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:34:41.973503    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742\": container with ID starting with a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742 not found: ID does not exist" containerID="a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"
Jul 27 19:34:41.973583 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.973530    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742"} err="failed to get container status \"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742\": rpc error: code = NotFound desc = could not find container \"a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742\": container with ID starting with a0de0fd86d426d99c0bbe1f6f3ccbdea28f05241ac203bdf5ee58cce6d011742 not found: ID does not exist"
Jul 27 19:34:41.976086 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.976062    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:34:41.982525 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:41.982500    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bb026c71-openshift-default-7b849fb4f4-zsxj8"]
Jul 27 19:34:43.781812 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:43.781780    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" path="/var/lib/kubelet/pods/6c84f56c-18b7-4c68-90f3-285a345ebf04/volumes"
Jul 27 19:34:46.963083 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:34:46.963055    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:35:14.936477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:14.936389    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:35:14.936967 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:14.936628    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" podUID="ed55829c-94aa-408a-9196-25ae76233b39" containerName="maas-api" containerID="cri-o://b644c3554913647d8500612e18e94e3ecfde0f1f876911e58bbe49b9d7f96656" gracePeriod=30
Jul 27 19:35:14.965493 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:14.965467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:15.070365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.070330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:15.096653 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.096625    2560 generic.go:356] "Generic (PLEG): container finished" podID="ed55829c-94aa-408a-9196-25ae76233b39" containerID="b644c3554913647d8500612e18e94e3ecfde0f1f876911e58bbe49b9d7f96656" exitCode=0
Jul 27 19:35:15.096807 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.096688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" event={"ID":"ed55829c-94aa-408a-9196-25ae76233b39","Type":"ContainerDied","Data":"b644c3554913647d8500612e18e94e3ecfde0f1f876911e58bbe49b9d7f96656"}
Jul 27 19:35:15.164306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.164276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:15.180610 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.180591    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:35:15.223526 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.223437    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:15.339099 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.339069    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:15.346191 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.346172    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp9m9\" (UniqueName: \"kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9\") pod \"ed55829c-94aa-408a-9196-25ae76233b39\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") "
Jul 27 19:35:15.346306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.346275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls\") pod \"ed55829c-94aa-408a-9196-25ae76233b39\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") "
Jul 27 19:35:15.346360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.346305    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca\") pod \"ed55829c-94aa-408a-9196-25ae76233b39\" (UID: \"ed55829c-94aa-408a-9196-25ae76233b39\") "
Jul 27 19:35:15.346685 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.346655    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed55829c-94aa-408a-9196-25ae76233b39" (UID: "ed55829c-94aa-408a-9196-25ae76233b39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:35:15.348433 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.348411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed55829c-94aa-408a-9196-25ae76233b39" (UID: "ed55829c-94aa-408a-9196-25ae76233b39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:35:15.348518 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.348450    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9" (OuterVolumeSpecName: "kube-api-access-mp9m9") pod "ed55829c-94aa-408a-9196-25ae76233b39" (UID: "ed55829c-94aa-408a-9196-25ae76233b39"). InnerVolumeSpecName "kube-api-access-mp9m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:15.447317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.447284    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed55829c-94aa-408a-9196-25ae76233b39-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.447317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.447311    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp9m9\" (UniqueName: \"kubernetes.io/projected/ed55829c-94aa-408a-9196-25ae76233b39-kube-api-access-mp9m9\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.447317 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.447320    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed55829c-94aa-408a-9196-25ae76233b39-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:35:15.587654 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:15.587556    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:16.080501 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.080469    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:16.102186 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.102152    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"
Jul 27 19:35:16.102378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.102207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg" event={"ID":"ed55829c-94aa-408a-9196-25ae76233b39","Type":"ContainerDied","Data":"d3ebf6b2a36ffa671dde06b5000f814a0d843e956be5903a2003a9eab6a30e57"}
Jul 27 19:35:16.102378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.102278    2560 scope.go:117] "RemoveContainer" containerID="b644c3554913647d8500612e18e94e3ecfde0f1f876911e58bbe49b9d7f96656"
Jul 27 19:35:16.132865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.132837    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:35:16.136834 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.136811    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5dae47b4-6554b7c48c-jj4qg"]
Jul 27 19:35:16.166289 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.166219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:16.266930 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:16.266905    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:17.729092 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:17.729019    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:17.780990 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:17.780960    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed55829c-94aa-408a-9196-25ae76233b39" path="/var/lib/kubelet/pods/ed55829c-94aa-408a-9196-25ae76233b39/volumes"
Jul 27 19:35:23.688124 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:23.688085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:23.755876 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:23.755845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:23.849775 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:23.849738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:23.950475 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:23.950407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:24.056340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:24.056308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:24.427271 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:24.427221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:50.491553 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:50.491521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:57.056045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:57.056008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:57.162102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:57.162065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:35:57.256004 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:35:57.255962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:13.201350 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:13.201315    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:18.827886 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:18.827847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:18.935233 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:18.935188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:19.060724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:19.060695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:29.687159 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:29.687123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:30.526048 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:30.526012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:36.999025 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:36.998990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:37.102082 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:37.102050    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:37.200514 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:37.200482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:37.300810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:37.300735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:38.172258 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:38.172223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:38.363650 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:38.363612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:38.459599 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:38.459512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:40.065390 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:40.065354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:45.819517 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:45.819431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:45.914945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:45.914912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:46.518700 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:46.518665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:53.238539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.238505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:53.338589 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.338555    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:53.500638 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.500563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:53.809970 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.809889    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:36:53.810223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810201    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.810223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810217    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810235    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810259    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810275    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed55829c-94aa-408a-9196-25ae76233b39" containerName="maas-api"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810283    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed55829c-94aa-408a-9196-25ae76233b39" containerName="maas-api"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810364    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed55829c-94aa-408a-9196-25ae76233b39" containerName="maas-api"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810372    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.810406 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.810378    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c84f56c-18b7-4c68-90f3-285a345ebf04" containerName="istio-proxy"
Jul 27 19:36:53.813122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.813107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.815784 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.815766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c581614e-openshift-default-dockercfg-vfxs6\""
Jul 27 19:36:53.831130 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.831106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:36:53.839574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.839549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:53.884495 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884495 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884699 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884699 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp99z\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884699 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884812 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884812 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.884884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.884872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.985991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.985957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp99z\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.985991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.985996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986267 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986785 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.986925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.986831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.989203 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.989176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.989382 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.989365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.995781 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.995757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp99z\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:53.995781 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:53.995772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token\") pod \"e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") " pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:54.123748 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.123724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:54.265900 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.265873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:36:54.267545 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:36:54.267519    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfdaa279_9017_47a3_9e99_954d9a2f43c8.slice/crio-4e8c8270ff6bc574fa1e7c80a13ebc6f31c0479fe4885a6b878f52f4684ba456 WatchSource:0}: Error finding container 4e8c8270ff6bc574fa1e7c80a13ebc6f31c0479fe4885a6b878f52f4684ba456: Status 404 returned error can't find the container with id 4e8c8270ff6bc574fa1e7c80a13ebc6f31c0479fe4885a6b878f52f4684ba456
Jul 27 19:36:54.270059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.270023    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:36:54.270147 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.270104    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:36:54.270209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.270144    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:36:54.448794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.448701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:54.525110 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.525075    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerStarted","Data":"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"}
Jul 27 19:36:54.525304 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.525134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerStarted","Data":"4e8c8270ff6bc574fa1e7c80a13ebc6f31c0479fe4885a6b878f52f4684ba456"}
Jul 27 19:36:54.545921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:54.545868    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podStartSLOduration=1.545848874 podStartE2EDuration="1.545848874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:54.543973354 +0000 UTC m=+1895.231837820" watchObservedRunningTime="2026-07-27 19:36:54.545848874 +0000 UTC m=+1895.233713314"
Jul 27 19:36:55.124821 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:55.124788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:55.125986 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:55.125960    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:36:55.126110 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:55.126010    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:36:56.127872 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.127844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:56.534346 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.534242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:56.535131 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.535114    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:36:56.686580 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.686543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:56.778689 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.778655    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:36:56.781810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.781785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:56.782828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.782802    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:56.783961 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.783937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c581614e-serving-cert\""
Jul 27 19:36:56.793625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.793599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:36:56.869648 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.869597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:56.912633 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.912596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82dj\" (UniqueName: \"kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:56.912828 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.912667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:56.912897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:56.912861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.014263 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.014224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.014443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.014332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.014443 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.014364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g82dj\" (UniqueName: \"kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.014825 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.014805    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.016877 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.016856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.031842 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.031823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82dj\" (UniqueName: \"kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj\") pod \"maas-api-e2e-mt-c581614e-78d7c458fb-9462z\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.092853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.092762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:57.203567 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.203533    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:57.237389 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.237368    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:36:57.239140 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:36:57.239114    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26cf33a_71f2_4e35_8f29_1b6c4bea561c.slice/crio-18c4ff70f184124ddcd688ad9ec6c4f18e42edce5c5c067f733f2dcf8167042d WatchSource:0}: Error finding container 18c4ff70f184124ddcd688ad9ec6c4f18e42edce5c5c067f733f2dcf8167042d: Status 404 returned error can't find the container with id 18c4ff70f184124ddcd688ad9ec6c4f18e42edce5c5c067f733f2dcf8167042d
Jul 27 19:36:57.540487 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.540436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" event={"ID":"a26cf33a-71f2-4e35-8f29-1b6c4bea561c","Type":"ContainerStarted","Data":"18c4ff70f184124ddcd688ad9ec6c4f18e42edce5c5c067f733f2dcf8167042d"}
Jul 27 19:36:57.566439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.566381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:57.662150 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:57.662116    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:36:58.546327 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:58.546282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" event={"ID":"a26cf33a-71f2-4e35-8f29-1b6c4bea561c","Type":"ContainerStarted","Data":"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"}
Jul 27 19:36:58.546818 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:58.546568    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:36:58.563126 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:36:58.563076    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" podStartSLOduration=1.9273422679999999 podStartE2EDuration="2.563060429s" totalImagesPullingTime="635.718161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:58.562142231 +0000 UTC m=+1899.250006672" watchObservedRunningTime="2026-07-27 19:36:58.563060429 +0000 UTC m=+1899.250924866"
Jul 27 19:37:01.216025 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:01.215993    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:01.936894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:01.936863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:02.036576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:02.036541    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:02.365465 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:02.365390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:04.556092 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:04.556064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:37:08.117608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:08.117570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:08.215117 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:08.215074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:11.536510 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.536471    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:37:11.536929 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.536529    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:37:11.610799 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.610762    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerID="530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6" exitCode=0
Jul 27 19:37:11.610956 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.610837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerDied","Data":"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"}
Jul 27 19:37:11.611238 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.611225    2560 scope.go:117] "RemoveContainer" containerID="530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"
Jul 27 19:37:11.612212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.612184    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:11.612347 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.612311    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:11.612419 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:11.612381    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:12.619607 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:12.619561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerStarted","Data":"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"}
Jul 27 19:37:13.124227 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:13.124193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:13.124636 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:13.124549    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:37:13.124793 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:13.124771    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:37:14.124151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:14.124103    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:37:14.124656 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:14.124172    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:37:14.653368 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:14.653332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:14.754740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:14.754711    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:15.125141 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:15.125104    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:37:15.125740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:15.125702    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:37:16.124629 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:16.124581    2560 patch_prober.go:28] interesting pod/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 27 19:37:16.124850 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:16.124654    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 27 19:37:17.128079 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:17.128051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:17.128555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:17.128307    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:17.128894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:17.128875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:18.865528 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:18.865499    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:37:18.865944 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:18.865719    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" podUID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" containerName="maas-api" containerID="cri-o://f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d" gracePeriod=30
Jul 27 19:37:18.895600 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:18.895580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:18.971149 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:18.971112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:19.040022 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.039967    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:19.111433 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.111408    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:37:19.136932 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.136902    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:19.223206 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.223166    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls\") pod \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") "
Jul 27 19:37:19.223374 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.223229    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g82dj\" (UniqueName: \"kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj\") pod \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") "
Jul 27 19:37:19.223374 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.223286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca\") pod \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\" (UID: \"a26cf33a-71f2-4e35-8f29-1b6c4bea561c\") "
Jul 27 19:37:19.223678 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.223654    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a26cf33a-71f2-4e35-8f29-1b6c4bea561c" (UID: "a26cf33a-71f2-4e35-8f29-1b6c4bea561c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:37:19.225360 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.225336    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a26cf33a-71f2-4e35-8f29-1b6c4bea561c" (UID: "a26cf33a-71f2-4e35-8f29-1b6c4bea561c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:37:19.225445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.225427    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj" (OuterVolumeSpecName: "kube-api-access-g82dj") pod "a26cf33a-71f2-4e35-8f29-1b6c4bea561c" (UID: "a26cf33a-71f2-4e35-8f29-1b6c4bea561c"). InnerVolumeSpecName "kube-api-access-g82dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:19.324067 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.324031    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.324067 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.324062    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g82dj\" (UniqueName: \"kubernetes.io/projected/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-kube-api-access-g82dj\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.324067 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.324072    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a26cf33a-71f2-4e35-8f29-1b6c4bea561c-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:19.439453 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.439367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:19.656161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.656131    2560 generic.go:356] "Generic (PLEG): container finished" podID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" containerID="f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d" exitCode=0
Jul 27 19:37:19.656161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.656166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" event={"ID":"a26cf33a-71f2-4e35-8f29-1b6c4bea561c","Type":"ContainerDied","Data":"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"}
Jul 27 19:37:19.656407 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.656176    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"
Jul 27 19:37:19.656407 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.656208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z" event={"ID":"a26cf33a-71f2-4e35-8f29-1b6c4bea561c","Type":"ContainerDied","Data":"18c4ff70f184124ddcd688ad9ec6c4f18e42edce5c5c067f733f2dcf8167042d"}
Jul 27 19:37:19.656407 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.656228    2560 scope.go:117] "RemoveContainer" containerID="f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"
Jul 27 19:37:19.672585 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.672556    2560 scope.go:117] "RemoveContainer" containerID="f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"
Jul 27 19:37:19.672995 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:37:19.672972    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d\": container with ID starting with f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d not found: ID does not exist" containerID="f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"
Jul 27 19:37:19.673074 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.673001    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d"} err="failed to get container status \"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d\": rpc error: code = NotFound desc = could not find container \"f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d\": container with ID starting with f65c4fd6e1846b2d7f39dc0e7b57c49b9a0605e0efa820c14039fb4be2e3f31d not found: ID does not exist"
Jul 27 19:37:19.683936 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.683914    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:37:19.688945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.688923    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c581614e-78d7c458fb-9462z"]
Jul 27 19:37:19.781782 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:19.781718    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" path="/var/lib/kubelet/pods/a26cf33a-71f2-4e35-8f29-1b6c4bea561c/volumes"
Jul 27 19:37:25.448625 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:25.448588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:25.700913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:25.700838    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:37:25.701049 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:25.701028    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy" containerID="cri-o://cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179" gracePeriod=30
Jul 27 19:37:27.081647 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:27.081614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:30.939750 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:30.939729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:31.022844 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.022768    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.022844 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.022803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.022844 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.022822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023104 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.022858    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023104 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.022982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp99z\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023104 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023104 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023170    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs\") pod \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\" (UID: \"dfdaa279-9017-47a3-9e99-954d9a2f43c8\") "
Jul 27 19:37:31.023351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023236    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:37:31.023527 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023495    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.023701 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023682    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:37:31.023898 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023863    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:37:31.023982 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:37:31.023982 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.023965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:37:31.025284 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.025231    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:37:31.025284 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.025271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z" (OuterVolumeSpecName: "kube-api-access-dp99z") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "kube-api-access-dp99z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:31.025544 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.025526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:31.025621 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.025523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfdaa279-9017-47a3-9e99-954d9a2f43c8" (UID: "dfdaa279-9017-47a3-9e99-954d9a2f43c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:37:31.124531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124503    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124525    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124534    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124543    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp99z\" (UniqueName: \"kubernetes.io/projected/dfdaa279-9017-47a3-9e99-954d9a2f43c8-kube-api-access-dp99z\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124553    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124560    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124568    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.124744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.124576    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfdaa279-9017-47a3-9e99-954d9a2f43c8-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:37:31.709479 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.709445    2560 generic.go:356] "Generic (PLEG): container finished" podID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerID="cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179" exitCode=0
Jul 27 19:37:31.709680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.709499    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"
Jul 27 19:37:31.709680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.709525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerDied","Data":"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"}
Jul 27 19:37:31.709680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.709574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb" event={"ID":"dfdaa279-9017-47a3-9e99-954d9a2f43c8","Type":"ContainerDied","Data":"4e8c8270ff6bc574fa1e7c80a13ebc6f31c0479fe4885a6b878f52f4684ba456"}
Jul 27 19:37:31.709680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.709597    2560 scope.go:117] "RemoveContainer" containerID="cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"
Jul 27 19:37:31.721242 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.721220    2560 scope.go:117] "RemoveContainer" containerID="530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"
Jul 27 19:37:31.728815 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.728791    2560 scope.go:117] "RemoveContainer" containerID="cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"
Jul 27 19:37:31.729055 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:37:31.729034    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179\": container with ID starting with cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179 not found: ID does not exist" containerID="cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"
Jul 27 19:37:31.729101 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.729064    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179"} err="failed to get container status \"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179\": rpc error: code = NotFound desc = could not find container \"cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179\": container with ID starting with cf1f5a7781974f9678e126eb8916b410180f08c0cfa8bd367a63a58fea4cf179 not found: ID does not exist"
Jul 27 19:37:31.729101 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.729080    2560 scope.go:117] "RemoveContainer" containerID="530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"
Jul 27 19:37:31.729306 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:37:31.729288    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6\": container with ID starting with 530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6 not found: ID does not exist" containerID="530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"
Jul 27 19:37:31.729392 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.729308    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6"} err="failed to get container status \"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6\": rpc error: code = NotFound desc = could not find container \"530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6\": container with ID starting with 530f3dc4dd050ca1c67c24f4a25f3f40cd4cc2abc554dda4bda8e4ef9e5dd6b6 not found: ID does not exist"
Jul 27 19:37:31.733555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.733531    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:37:31.737136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.737117    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c581614e-openshift-default-7d49b6db96-npqtb"]
Jul 27 19:37:31.781034 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:31.780997    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" path="/var/lib/kubelet/pods/dfdaa279-9017-47a3-9e99-954d9a2f43c8/volumes"
Jul 27 19:37:32.046873 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:32.046798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:32.167879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:32.167849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:32.251608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:32.251579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:32.422866 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:32.422839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:38.230142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:38.230100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:38.291779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:38.291747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:45.118103 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.118063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:45.414833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.414754    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:37:45.415105 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415091    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" containerName="maas-api"
Jul 27 19:37:45.415155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415109    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" containerName="maas-api"
Jul 27 19:37:45.415155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415122    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415127    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415138    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415155 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415143    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415321 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415204    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415321 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415213    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfdaa279-9017-47a3-9e99-954d9a2f43c8" containerName="istio-proxy"
Jul 27 19:37:45.415321 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.415221    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26cf33a-71f2-4e35-8f29-1b6c4bea561c" containerName="maas-api"
Jul 27 19:37:45.419676 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.419655    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.423468 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.423448    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-76809045-openshift-default-dockercfg-z6m22\""
Jul 27 19:37:45.438539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.438503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:37:45.502214 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.502181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:45.548539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcsqh\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.548881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.548845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.649877 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.649877 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsqh\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.649977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650534 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650534 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650629 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.650798 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.650781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.652220 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.652202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.652496 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.652478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.662397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.662368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcsqh\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.662533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.662441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token\") pod \"e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") " pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.703315 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.703229    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:45.729365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.729340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:45.863791 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.863759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:37:45.866903 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:37:45.866878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba89836_602b_43a1_93ba_0fed8cb26229.slice/crio-4852417f8761dc2d1a4e0fd74bae577992665a1148d5b930bd800436f05558f2 WatchSource:0}: Error finding container 4852417f8761dc2d1a4e0fd74bae577992665a1148d5b930bd800436f05558f2: Status 404 returned error can't find the container with id 4852417f8761dc2d1a4e0fd74bae577992665a1148d5b930bd800436f05558f2
Jul 27 19:37:45.868934 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.868906    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:45.869111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.868969    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:45.869111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:45.869018    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:37:46.777309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:46.777271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerStarted","Data":"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"}
Jul 27 19:37:46.777686 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:46.777329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerStarted","Data":"4852417f8761dc2d1a4e0fd74bae577992665a1148d5b930bd800436f05558f2"}
Jul 27 19:37:46.797580 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:46.797494    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podStartSLOduration=1.797477547 podStartE2EDuration="1.797477547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:46.796162451 +0000 UTC m=+1947.484026900" watchObservedRunningTime="2026-07-27 19:37:46.797477547 +0000 UTC m=+1947.485342050"
Jul 27 19:37:47.729622 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:47.729589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:47.734051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:47.734028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:47.781543 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:47.781515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:47.782093 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:47.782076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:37:48.794532 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:48.794496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:48.888064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:48.888033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:48.955290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:48.955234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:49.084707 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:49.084600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:49.392515 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:49.392487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:49.505577 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:49.505549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:53.300784 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:53.300747    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:37:59.972142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:37:59.972105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:02.959546 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:02.957547    2560 patch_prober.go:28] interesting pod/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:34354->10.134.0.36:15021: read: connection reset by peer" start-of-body=
Jul 27 19:38:02.959546 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:02.957627    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:34354->10.134.0.36:15021: read: connection reset by peer"
Jul 27 19:38:03.855737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.855704    2560 generic.go:356] "Generic (PLEG): container finished" podID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerID="725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462" exitCode=0
Jul 27 19:38:03.855885 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.855781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerDied","Data":"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"}
Jul 27 19:38:03.856179 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.856157    2560 scope.go:117] "RemoveContainer" containerID="725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"
Jul 27 19:38:03.857145 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.857119    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:38:03.857270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.857198    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:38:03.857270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:03.857242    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:38:04.863458 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:04.863426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerStarted","Data":"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"}
Jul 27 19:38:05.730565 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:05.730530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:38:05.730928 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:05.730906    2560 patch_prober.go:28] interesting pod/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:38:05.731081 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:05.731057    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 27 19:38:06.730397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:06.730357    2560 patch_prober.go:28] interesting pod/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:38:06.730946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:06.730914    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 27 19:38:07.730020 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:07.729967    2560 patch_prober.go:28] interesting pod/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:38:07.730329 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:07.730042    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 27 19:38:08.730093 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:08.730057    2560 patch_prober.go:28] interesting pod/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 27 19:38:08.730702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:08.730672    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 27 19:38:09.733503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:09.733472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:38:09.733891 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:09.733831    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:38:09.734512 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:09.734492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:38:38.315946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:38.315911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:38.390094 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:38.390058    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:38.460512 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:38.460483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:38.563472 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:38.563441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:42.082526 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:42.082486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:38:47.159003 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:38:47.158967    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:20.594110 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:20.594073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:20.654230 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:20.654196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:23.434080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:23.434047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:24.350555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:24.350519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:30.145113 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.145078    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:30.243689 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.243660    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:30.422670 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.422587    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:39:30.422824 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.422776    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy" containerID="cri-o://9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf" gracePeriod=30
Jul 27 19:39:30.453824 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.453792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:30.718456 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:30.718357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:31.933259 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:31.933210    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:32.097134 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:32.097101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:32.235012 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:32.234932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:32.952849 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:32.952811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:33.052609 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:33.052578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:33.152082 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:33.152053    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:34.663894 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:34.663864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:35.678763 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.678738    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:39:35.791997 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.791909    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.791995    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792022    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792120    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792168 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcsqh\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792188    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792212    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy\") pod \"1ba89836-602b-43a1-93ba-0fed8cb26229\" (UID: \"1ba89836-602b-43a1-93ba-0fed8cb26229\") "
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792302    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792353    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:35.792477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:35.792925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792596    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.792925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792618    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.792925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.792636    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.793107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.793029    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:39:35.793275 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.793226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:35.794382 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.794346    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:39:35.794632 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.794609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh" (OuterVolumeSpecName: "kube-api-access-lcsqh") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "kube-api-access-lcsqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:39:35.794719 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.794626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:39:35.794821 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.794806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ba89836-602b-43a1-93ba-0fed8cb26229" (UID: "1ba89836-602b-43a1-93ba-0fed8cb26229"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:35.893999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.893962    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.893999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.893998    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.893999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.894010    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ba89836-602b-43a1-93ba-0fed8cb26229-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.894223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.894018    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcsqh\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-kube-api-access-lcsqh\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.894223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.894028    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:35.894223 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:35.894035    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ba89836-602b-43a1-93ba-0fed8cb26229-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:39:36.252380 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.252334    2560 generic.go:356] "Generic (PLEG): container finished" podID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerID="9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf" exitCode=0
Jul 27 19:39:36.252574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.252399    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"
Jul 27 19:39:36.252574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.252416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerDied","Data":"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"}
Jul 27 19:39:36.252574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.252507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9" event={"ID":"1ba89836-602b-43a1-93ba-0fed8cb26229","Type":"ContainerDied","Data":"4852417f8761dc2d1a4e0fd74bae577992665a1148d5b930bd800436f05558f2"}
Jul 27 19:39:36.252574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.252538    2560 scope.go:117] "RemoveContainer" containerID="9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"
Jul 27 19:39:36.262833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.262818    2560 scope.go:117] "RemoveContainer" containerID="725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"
Jul 27 19:39:36.271665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.271644    2560 scope.go:117] "RemoveContainer" containerID="9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"
Jul 27 19:39:36.271973 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:39:36.271952    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf\": container with ID starting with 9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf not found: ID does not exist" containerID="9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"
Jul 27 19:39:36.272089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.271985    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf"} err="failed to get container status \"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf\": rpc error: code = NotFound desc = could not find container \"9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf\": container with ID starting with 9d3fab7669ac68812a82451983b32706906ee4e97372001e509bd7d663c448bf not found: ID does not exist"
Jul 27 19:39:36.272089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.272008    2560 scope.go:117] "RemoveContainer" containerID="725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"
Jul 27 19:39:36.272298 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:39:36.272278    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462\": container with ID starting with 725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462 not found: ID does not exist" containerID="725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"
Jul 27 19:39:36.272350 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.272306    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462"} err="failed to get container status \"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462\": rpc error: code = NotFound desc = could not find container \"725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462\": container with ID starting with 725fa78158ac163937b2b58f6b2f41ac5ceb5bb4b63d3bcaaa912ef055eee462 not found: ID does not exist"
Jul 27 19:39:36.280069 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.280048    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:39:36.285227 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:36.285207    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-76809045-openshift-default-8499bd4bf6-b54g9"]
Jul 27 19:39:37.781944 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:37.781911    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" path="/var/lib/kubelet/pods/1ba89836-602b-43a1-93ba-0fed8cb26229/volumes"
Jul 27 19:39:40.423464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:40.423420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:40.523208 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:40.523175    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:41.152708 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:41.152672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:48.443940 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:48.443891    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:48.544722 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:48.544693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:48.647690 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:48.647653    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:39:59.696069 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:39:59.696036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:00.317790 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:00.317760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:03.046212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:03.046176    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:03.100151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:03.100119    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:21.692810 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:21.692776    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:28.199721 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:28.199684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:28.301492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:28.301432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:28.631516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:28.631482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:28.962670 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:28.962589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:29.208804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:29.208774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:32.371314 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.371279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:32.457838 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.457800    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:40:32.458297 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458278    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.458377 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458300    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.458377 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458339    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.458377 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458348    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.458545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458425    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.458545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.458445    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba89836-602b-43a1-93ba-0fed8cb26229" containerName="istio-proxy"
Jul 27 19:40:32.459143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.459118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:32.460588 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.460571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.463145 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.463118    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-35bf7c-serving-cert\""
Jul 27 19:40:32.472896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.472874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:40:32.540112 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.540080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:32.551190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.551164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.551336 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.551191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbb2\" (UniqueName: \"kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.551336 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.551271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.652578 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.652486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.652578 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.652556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.652808 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.652584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbb2\" (UniqueName: \"kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.652808 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:40:32.652695    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-serving-cert: secret "maas-api-e2e-inf-a-35bf7c-serving-cert" not found
Jul 27 19:40:32.652808 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:40:32.652770    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls podName:ac1de959-3542-46a8-a36b-a02aa868be43 nodeName:}" failed. No retries permitted until 2026-07-27 19:40:33.152751606 +0000 UTC m=+2113.840616025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls") pod "maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" (UID: "ac1de959-3542-46a8-a36b-a02aa868be43") : secret "maas-api-e2e-inf-a-35bf7c-serving-cert" not found
Jul 27 19:40:32.653144 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.653123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.663529 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.663502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbb2\" (UniqueName: \"kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:32.890629 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:32.890598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:33.079501 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.079427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:33.156799 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.156774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:33.159214 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.159191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") pod \"maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:33.175100 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.175072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:33.370599 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.370563    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:33.520725 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.520700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:40:33.522771 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:40:33.522745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1de959_3542_46a8_a36b_a02aa868be43.slice/crio-c2a4af324bd5f8810f75c14fbd0d4d475615c57997f62dd8d3ab8e7b97c1bdb1 WatchSource:0}: Error finding container c2a4af324bd5f8810f75c14fbd0d4d475615c57997f62dd8d3ab8e7b97c1bdb1: Status 404 returned error can't find the container with id c2a4af324bd5f8810f75c14fbd0d4d475615c57997f62dd8d3ab8e7b97c1bdb1
Jul 27 19:40:33.524350 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:33.524334    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:40:34.495672 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:34.495631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" event={"ID":"ac1de959-3542-46a8-a36b-a02aa868be43","Type":"ContainerStarted","Data":"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"}
Jul 27 19:40:34.495838 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:34.495693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" event={"ID":"ac1de959-3542-46a8-a36b-a02aa868be43","Type":"ContainerStarted","Data":"c2a4af324bd5f8810f75c14fbd0d4d475615c57997f62dd8d3ab8e7b97c1bdb1"}
Jul 27 19:40:34.495838 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:34.495718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:34.512822 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:34.512777    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" podStartSLOduration=2.079932172 podStartE2EDuration="2.5127639s" totalImagesPullingTime="432.831728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:34.511745217 +0000 UTC m=+2115.199609682" watchObservedRunningTime="2026-07-27 19:40:34.5127639 +0000 UTC m=+2115.200628338"
Jul 27 19:40:36.933710 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:36.933669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:37.302265 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.302138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:37.613099 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.613029    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:40:37.615414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.615397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.617859 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.617839    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d59e9c-openshift-default-dockercfg-bbqn5\""
Jul 27 19:40:37.628001 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.627983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:40:37.649545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.649520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:37.693091 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693305 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693305 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9s22\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693404 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693404 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.693503 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.693457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794641 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.794814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9s22\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.794908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.795016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.795032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795352 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.795135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795352 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.795226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.795665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.795643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.797146 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.797122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.797583 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.797564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.803809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.803772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.804499 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.804475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9s22\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22\") pod \"e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") " pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:37.906856 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.906823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:37.925754 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:37.925728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:38.057427 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.057396    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:40:38.060291 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:40:38.060236    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc70c4e_2a71_422a_b0d5_d38b63b467b7.slice/crio-dccd411d0f560ee967f8913e470d4d6ba47d9ff4eccbb5e5f4ad3b6dd3a5ff95 WatchSource:0}: Error finding container dccd411d0f560ee967f8913e470d4d6ba47d9ff4eccbb5e5f4ad3b6dd3a5ff95: Status 404 returned error can't find the container with id dccd411d0f560ee967f8913e470d4d6ba47d9ff4eccbb5e5f4ad3b6dd3a5ff95
Jul 27 19:40:38.062821 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.062790    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:38.062933 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.062867    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:38.062933 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.062911    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:38.513561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.513527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerStarted","Data":"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"}
Jul 27 19:40:38.513751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.513589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerStarted","Data":"dccd411d0f560ee967f8913e470d4d6ba47d9ff4eccbb5e5f4ad3b6dd3a5ff95"}
Jul 27 19:40:38.535916 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.535871    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podStartSLOduration=1.535856755 podStartE2EDuration="1.535856755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:38.535226024 +0000 UTC m=+2119.223090463" watchObservedRunningTime="2026-07-27 19:40:38.535856755 +0000 UTC m=+2119.223721194"
Jul 27 19:40:38.926004 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:38.925978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:39.930701 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:39.930669    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:40.504868 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.504842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:40:40.514142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.514113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:40.521928 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.521899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:40.522984 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.522963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:40.613594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.613562    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:40.694067 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.694036    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:40:40.696332 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.696312    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.698874 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.698854    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d59e9c-serving-cert\""
Jul 27 19:40:40.708095 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.708077    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:40:40.763002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.762929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:40.815824 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.815793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwfc8\" (UniqueName: \"kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.815942 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.815882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.815942 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.815920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.916604 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.916570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.916604 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.916611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.916814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.916654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwfc8\" (UniqueName: \"kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.916861 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:40:40.916808    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-serving-cert: secret "maas-api-e2e-inf-b-d59e9c-serving-cert" not found
Jul 27 19:40:40.916896 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:40:40.916882    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls podName:0c616e7a-dbd3-469c-b8e6-0880c96d6241 nodeName:}" failed. No retries permitted until 2026-07-27 19:40:41.416860932 +0000 UTC m=+2122.104725352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls") pod "maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" (UID: "0c616e7a-dbd3-469c-b8e6-0880c96d6241") : secret "maas-api-e2e-inf-b-d59e9c-serving-cert" not found
Jul 27 19:40:40.917209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.917192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:40.926499 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:40.926467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwfc8\" (UniqueName: \"kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:41.041318 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.041224    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:41.422811 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.422570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:41.425740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.425713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") pod \"maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:41.444177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.444153    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:41.544116 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.544080    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:41.608507 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.608481    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:41.747655 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:41.747629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:40:41.749937 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:40:41.749913    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c616e7a_dbd3_469c_b8e6_0880c96d6241.slice/crio-b9b3507a80654d39e9658b3a5b8a4b161ef41897b0b07f8c785d6551c92e287b WatchSource:0}: Error finding container b9b3507a80654d39e9658b3a5b8a4b161ef41897b0b07f8c785d6551c92e287b: Status 404 returned error can't find the container with id b9b3507a80654d39e9658b3a5b8a4b161ef41897b0b07f8c785d6551c92e287b
Jul 27 19:40:42.531920 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:42.531889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" event={"ID":"0c616e7a-dbd3-469c-b8e6-0880c96d6241","Type":"ContainerStarted","Data":"b9b3507a80654d39e9658b3a5b8a4b161ef41897b0b07f8c785d6551c92e287b"}
Jul 27 19:40:43.537664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:43.537633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" event={"ID":"0c616e7a-dbd3-469c-b8e6-0880c96d6241","Type":"ContainerStarted","Data":"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"}
Jul 27 19:40:43.538089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:43.537695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:43.553738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:43.553694    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" podStartSLOduration=2.614972365 podStartE2EDuration="3.553679144s" totalImagesPullingTime="938.706779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:43.553009422 +0000 UTC m=+2124.240873879" watchObservedRunningTime="2026-07-27 19:40:43.553679144 +0000 UTC m=+2124.241543583"
Jul 27 19:40:45.072921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:45.072888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:49.547881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:49.547850    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:40:54.587809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.587777    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerID="c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d" exitCode=0
Jul 27 19:40:54.588226 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.587843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerDied","Data":"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"}
Jul 27 19:40:54.588226 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.588211    2560 scope.go:117] "RemoveContainer" containerID="c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"
Jul 27 19:40:54.589371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.589337    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:54.589452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.589428    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:54.589515 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:54.589498    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:40:55.522143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:55.522112    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:55.594631 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:55.594595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerStarted","Data":"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"}
Jul 27 19:40:55.926517 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:55.926477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:55.928059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:55.928026    2560 patch_prober.go:28] interesting pod/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:40:55.928328 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:55.928298    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 27 19:40:56.927135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:56.926684    2560 patch_prober.go:28] interesting pod/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:40:56.927135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:56.926750    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 27 19:40:57.926983 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:57.926941    2560 patch_prober.go:28] interesting pod/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:40:57.927319 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:57.927286    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 27 19:40:58.926677 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:58.926635    2560 patch_prober.go:28] interesting pod/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 27 19:40:58.926913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:58.926735    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 27 19:40:59.757970 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:59.757929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:40:59.930947 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:59.930913    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:59.931217 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:59.931195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:40:59.931801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:40:59.931784    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:41:14.073877 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:41:14.073792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:54.745282 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:41:54.745219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:41:55.670584 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:41:55.670546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:06.273981 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.273947    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:42:06.274478 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.274160    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" podUID="ac1de959-3542-46a8-a36b-a02aa868be43" containerName="maas-api" containerID="cri-o://0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903" gracePeriod=30
Jul 27 19:42:06.315012 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.314982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:06.429361 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.429322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:06.505145 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.505117    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:06.515858 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.515831    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:42:06.563999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.563914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmbb2\" (UniqueName: \"kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2\") pod \"ac1de959-3542-46a8-a36b-a02aa868be43\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") "
Jul 27 19:42:06.564140 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.564003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca\") pod \"ac1de959-3542-46a8-a36b-a02aa868be43\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") "
Jul 27 19:42:06.564140 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.564055    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") pod \"ac1de959-3542-46a8-a36b-a02aa868be43\" (UID: \"ac1de959-3542-46a8-a36b-a02aa868be43\") "
Jul 27 19:42:06.564395 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.564363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac1de959-3542-46a8-a36b-a02aa868be43" (UID: "ac1de959-3542-46a8-a36b-a02aa868be43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:06.566175 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.566148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2" (OuterVolumeSpecName: "kube-api-access-lmbb2") pod "ac1de959-3542-46a8-a36b-a02aa868be43" (UID: "ac1de959-3542-46a8-a36b-a02aa868be43"). InnerVolumeSpecName "kube-api-access-lmbb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:06.566281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.566173    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac1de959-3542-46a8-a36b-a02aa868be43" (UID: "ac1de959-3542-46a8-a36b-a02aa868be43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:42:06.664991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.664950    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac1de959-3542-46a8-a36b-a02aa868be43-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.665157 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.664994    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmbb2\" (UniqueName: \"kubernetes.io/projected/ac1de959-3542-46a8-a36b-a02aa868be43-kube-api-access-lmbb2\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.665157 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.665011    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1de959-3542-46a8-a36b-a02aa868be43-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:06.907452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.907412    2560 generic.go:356] "Generic (PLEG): container finished" podID="ac1de959-3542-46a8-a36b-a02aa868be43" containerID="0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903" exitCode=0
Jul 27 19:42:06.907634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.907459    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"
Jul 27 19:42:06.907634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.907478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" event={"ID":"ac1de959-3542-46a8-a36b-a02aa868be43","Type":"ContainerDied","Data":"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"}
Jul 27 19:42:06.907634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.907528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q" event={"ID":"ac1de959-3542-46a8-a36b-a02aa868be43","Type":"ContainerDied","Data":"c2a4af324bd5f8810f75c14fbd0d4d475615c57997f62dd8d3ab8e7b97c1bdb1"}
Jul 27 19:42:06.907634 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.907556    2560 scope.go:117] "RemoveContainer" containerID="0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"
Jul 27 19:42:06.916212 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.916193    2560 scope.go:117] "RemoveContainer" containerID="0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"
Jul 27 19:42:06.916501 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:06.916480    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903\": container with ID starting with 0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903 not found: ID does not exist" containerID="0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"
Jul 27 19:42:06.916568 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.916513    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903"} err="failed to get container status \"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903\": rpc error: code = NotFound desc = could not find container \"0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903\": container with ID starting with 0de26604d55db32dbf6c4bc89e106ec7df5d4e8288b46e61120d29d3f1884903 not found: ID does not exist"
Jul 27 19:42:06.923459 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.923430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:06.927683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.927659    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:42:06.930917 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:06.930896    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-35bf7c-55489fdc85-2rf2q"]
Jul 27 19:42:07.781916 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:07.781878    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac1de959-3542-46a8-a36b-a02aa868be43" path="/var/lib/kubelet/pods/ac1de959-3542-46a8-a36b-a02aa868be43/volumes"
Jul 27 19:42:10.966865 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:10.966833    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:12.722966 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:12.722893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:12.819136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:12.819095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:13.025066 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:13.024964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:13.309022 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:13.308906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:19.460027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:19.459981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:23.730635 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:23.730602    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:42:23.731123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:23.730801    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" podUID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" containerName="maas-api" containerID="cri-o://9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2" gracePeriod=30
Jul 27 19:42:23.757468 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:23.757418    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:23.835370 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:23.835339    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:23.935403 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:23.935364    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:24.000375 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.000263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:24.173744 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.173720    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:42:24.321609 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.321521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwfc8\" (UniqueName: \"kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8\") pod \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") "
Jul 27 19:42:24.321609 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.321569    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") pod \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") "
Jul 27 19:42:24.321836 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.321674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca\") pod \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\" (UID: \"0c616e7a-dbd3-469c-b8e6-0880c96d6241\") "
Jul 27 19:42:24.322057 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.322035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c616e7a-dbd3-469c-b8e6-0880c96d6241" (UID: "0c616e7a-dbd3-469c-b8e6-0880c96d6241"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:24.323814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.323791    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c616e7a-dbd3-469c-b8e6-0880c96d6241" (UID: "0c616e7a-dbd3-469c-b8e6-0880c96d6241"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:42:24.323917 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.323874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8" (OuterVolumeSpecName: "kube-api-access-nwfc8") pod "0c616e7a-dbd3-469c-b8e6-0880c96d6241" (UID: "0c616e7a-dbd3-469c-b8e6-0880c96d6241"). InnerVolumeSpecName "kube-api-access-nwfc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:24.359793 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.359762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:24.422342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.422307    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c616e7a-dbd3-469c-b8e6-0880c96d6241-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.422342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.422337    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwfc8\" (UniqueName: \"kubernetes.io/projected/0c616e7a-dbd3-469c-b8e6-0880c96d6241-kube-api-access-nwfc8\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.422342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.422351    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c616e7a-dbd3-469c-b8e6-0880c96d6241-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:24.988588 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.988554    2560 generic.go:356] "Generic (PLEG): container finished" podID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" containerID="9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2" exitCode=0
Jul 27 19:42:24.989077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.988594    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"
Jul 27 19:42:24.989077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.988638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" event={"ID":"0c616e7a-dbd3-469c-b8e6-0880c96d6241","Type":"ContainerDied","Data":"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"}
Jul 27 19:42:24.989077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.988685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5" event={"ID":"0c616e7a-dbd3-469c-b8e6-0880c96d6241","Type":"ContainerDied","Data":"b9b3507a80654d39e9658b3a5b8a4b161ef41897b0b07f8c785d6551c92e287b"}
Jul 27 19:42:24.989077 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.988705    2560 scope.go:117] "RemoveContainer" containerID="9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"
Jul 27 19:42:24.997405 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.997390    2560 scope.go:117] "RemoveContainer" containerID="9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"
Jul 27 19:42:24.997642 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:24.997627    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2\": container with ID starting with 9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2 not found: ID does not exist" containerID="9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"
Jul 27 19:42:24.997683 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:24.997653    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2"} err="failed to get container status \"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2\": rpc error: code = NotFound desc = could not find container \"9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2\": container with ID starting with 9e03b2729c2bad3c3fc73cff012c76887b3fb59dfbd8a95cc131523df7c5f4a2 not found: ID does not exist"
Jul 27 19:42:25.009302 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:25.009235    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:42:25.013676 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:25.013658    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d59e9c-547588ffc7-9pfd5"]
Jul 27 19:42:25.781757 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:25.781727    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" path="/var/lib/kubelet/pods/0c616e7a-dbd3-469c-b8e6-0880c96d6241/volumes"
Jul 27 19:42:30.037340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:30.037307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:30.312872 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:30.312793    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:42:30.313071 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:30.313037    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy" containerID="cri-o://3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6" gracePeriod=30
Jul 27 19:42:31.899287 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:31.899243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.191388 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.191352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.271886 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.271855    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:42:34.272334 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272318    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" containerName="maas-api"
Jul 27 19:42:34.272387 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272337    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" containerName="maas-api"
Jul 27 19:42:34.272387 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272369    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1de959-3542-46a8-a36b-a02aa868be43" containerName="maas-api"
Jul 27 19:42:34.272387 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272379    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1de959-3542-46a8-a36b-a02aa868be43" containerName="maas-api"
Jul 27 19:42:34.272481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272454    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1de959-3542-46a8-a36b-a02aa868be43" containerName="maas-api"
Jul 27 19:42:34.272481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.272465    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c616e7a-dbd3-469c-b8e6-0880c96d6241" containerName="maas-api"
Jul 27 19:42:34.275574 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.275555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.277169 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.277127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.277931 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.277912    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-944fa0-serving-cert\""
Jul 27 19:42:34.286378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.286353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:42:34.305814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.305785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklch\" (UniqueName: \"kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.306011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.305841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.306011 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.305933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.346694 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.346656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.406967 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.406927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.407156 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.406978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.407156 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.407013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lklch\" (UniqueName: \"kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.407707 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.407679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.409401 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.409383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.414893 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.414876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklch\" (UniqueName: \"kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch\") pod \"maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.446688 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.446596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.586261 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.586222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:34.715900 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.715876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:42:34.718166 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:42:34.718138    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaad9a2_4cfc_4ab0_bb23_69e106f35b6e.slice/crio-7aa150a331004bf7ded6199696cf2d1d4a3f28db55bc660dad1f1cd3ad03a0e9 WatchSource:0}: Error finding container 7aa150a331004bf7ded6199696cf2d1d4a3f28db55bc660dad1f1cd3ad03a0e9: Status 404 returned error can't find the container with id 7aa150a331004bf7ded6199696cf2d1d4a3f28db55bc660dad1f1cd3ad03a0e9
Jul 27 19:42:34.861757 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.861721    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:34.965136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:34.965101    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:35.034260 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.034165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" event={"ID":"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e","Type":"ContainerStarted","Data":"7aa150a331004bf7ded6199696cf2d1d4a3f28db55bc660dad1f1cd3ad03a0e9"}
Jul 27 19:42:35.552087 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.552059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:42:35.617977 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.617948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.617995    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618065    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9s22\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618097    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618151 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:35.618505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token\") pod \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\" (UID: \"8bc70c4e-2a71-422a-b0d5-d38b63b467b7\") "
Jul 27 19:42:35.618505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618489    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:35.618505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:35.618751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:42:35.618751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618609    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.618751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618658    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.618751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618673    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.618751 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.618686    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.619606 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.619579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:35.620492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.620462    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:42:35.620492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.620481    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22" (OuterVolumeSpecName: "kube-api-access-q9s22") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "kube-api-access-q9s22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:35.620665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.620521    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:35.620665 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.620577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8bc70c4e-2a71-422a-b0d5-d38b63b467b7" (UID: "8bc70c4e-2a71-422a-b0d5-d38b63b467b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:35.719135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.719100    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.719135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.719128    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.719135 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.719137    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.719403 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.719145    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9s22\" (UniqueName: \"kubernetes.io/projected/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-kube-api-access-q9s22\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:35.719403 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:35.719154    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc70c4e-2a71-422a-b0d5-d38b63b467b7-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:42:36.040801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.040706    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerID="3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6" exitCode=0
Jul 27 19:42:36.040801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.040741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerDied","Data":"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"}
Jul 27 19:42:36.040801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.040767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"
Jul 27 19:42:36.040801 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.040797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc" event={"ID":"8bc70c4e-2a71-422a-b0d5-d38b63b467b7","Type":"ContainerDied","Data":"dccd411d0f560ee967f8913e470d4d6ba47d9ff4eccbb5e5f4ad3b6dd3a5ff95"}
Jul 27 19:42:36.041121 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.040822    2560 scope.go:117] "RemoveContainer" containerID="3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"
Jul 27 19:42:36.042351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.042319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" event={"ID":"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e","Type":"ContainerStarted","Data":"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"}
Jul 27 19:42:36.042439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.042422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:36.049736 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.049721    2560 scope.go:117] "RemoveContainer" containerID="c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"
Jul 27 19:42:36.057896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.057878    2560 scope.go:117] "RemoveContainer" containerID="3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"
Jul 27 19:42:36.058152 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:36.058132    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6\": container with ID starting with 3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6 not found: ID does not exist" containerID="3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"
Jul 27 19:42:36.058204 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.058162    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6"} err="failed to get container status \"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6\": rpc error: code = NotFound desc = could not find container \"3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6\": container with ID starting with 3d32fa24d38a2b914fba523ff1787e3b8494b8485f803070dae97c4920f183d6 not found: ID does not exist"
Jul 27 19:42:36.058204 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.058180    2560 scope.go:117] "RemoveContainer" containerID="c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"
Jul 27 19:42:36.058326 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.058242    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:42:36.058480 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:36.058461    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d\": container with ID starting with c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d not found: ID does not exist" containerID="c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"
Jul 27 19:42:36.058522 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.058487    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d"} err="failed to get container status \"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d\": rpc error: code = NotFound desc = could not find container \"c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d\": container with ID starting with c3a00b61985d16b4095ab24343c4da4fd373c300e88093074ba51d871ae6066d not found: ID does not exist"
Jul 27 19:42:36.062446 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.062426    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d59e9c-openshift-default-59f56ff4b6-269lc"]
Jul 27 19:42:36.076445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:36.076401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" podStartSLOduration=1.650415936 podStartE2EDuration="2.076387428s" totalImagesPullingTime="425.971492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:36.075602022 +0000 UTC m=+2236.763466472" watchObservedRunningTime="2026-07-27 19:42:36.076387428 +0000 UTC m=+2236.764251866"
Jul 27 19:42:37.781601 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:37.781569    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" path="/var/lib/kubelet/pods/8bc70c4e-2a71-422a-b0d5-d38b63b467b7/volumes"
Jul 27 19:42:38.766026 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:38.765991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:39.211616 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.211580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:39.496302 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496203    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:42:39.496734 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496717    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.496805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496738    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.496805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496753    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.496805 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496763    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.496906 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496832    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.496906 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.496847    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc70c4e-2a71-422a-b0d5-d38b63b467b7" containerName="istio-proxy"
Jul 27 19:42:39.500285 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.500265    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.502611 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.502589    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-74909c-openshift-default-dockercfg-j49f7\""
Jul 27 19:42:39.509630 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.509608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:42:39.524691 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.524659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:39.552757 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.552913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79bsl\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.552913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.552913 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.553013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.553013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.553013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.552997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.553102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.553026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.553102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.553049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79bsl\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654372 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654372 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654372 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.654729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.655447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.654849    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.655447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.655105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.655447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.655393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.657368 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.657303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.657945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.657919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.663307 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.663284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.663554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.663532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79bsl\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl\") pod \"e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") " pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.692371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.692322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:39.811549 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.811462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:39.961566 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.961540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:42:39.963732 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:42:39.963691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc01930_0e6f_498d_b7f7_1ddeee1753ca.slice/crio-e3134b644541e00dc79a7c3c92057ea14e3bd4ed67bf6caede9376acf3bdfcc2 WatchSource:0}: Error finding container e3134b644541e00dc79a7c3c92057ea14e3bd4ed67bf6caede9376acf3bdfcc2: Status 404 returned error can't find the container with id e3134b644541e00dc79a7c3c92057ea14e3bd4ed67bf6caede9376acf3bdfcc2
Jul 27 19:42:39.966118 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.966080    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:39.966182 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.966164    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:39.966219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:39.966204    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:40.064695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:40.064607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerStarted","Data":"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"}
Jul 27 19:42:40.064695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:40.064668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerStarted","Data":"e3134b644541e00dc79a7c3c92057ea14e3bd4ed67bf6caede9376acf3bdfcc2"}
Jul 27 19:42:40.084698 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:40.084653    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podStartSLOduration=1.084637255 podStartE2EDuration="1.084637255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:40.083015737 +0000 UTC m=+2240.770880198" watchObservedRunningTime="2026-07-27 19:42:40.084637255 +0000 UTC m=+2240.772501750"
Jul 27 19:42:40.812383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:40.812304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:41.817343 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:41.817313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:42.052978 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.052953    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:42:42.073280 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.073173    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:42.074057 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.074039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:42.282800 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.282768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:42.309517 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.309486    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:42:42.311836 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.311816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.314582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.314563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-74909c-serving-cert\""
Jul 27 19:42:42.324334 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.324271    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:42:42.379213 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.379171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.379416 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.379224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.379416 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.379326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txk4\" (UniqueName: \"kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.383309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.383279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:42.480314 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.480275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.480472 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.480326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.480472 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.480359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txk4\" (UniqueName: \"kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.480472 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:42.480442    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-serving-cert: secret "maas-api-e2e-api-b-74909c-serving-cert" not found
Jul 27 19:42:42.480622 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:42:42.480519    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls podName:aa48ec82-ed0c-4766-8364-c54be9ae97c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:42:42.980498446 +0000 UTC m=+2243.668362866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls") pod "maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" (UID: "aa48ec82-ed0c-4766-8364-c54be9ae97c6") : secret "maas-api-e2e-api-b-74909c-serving-cert" not found
Jul 27 19:42:42.481028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.481009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.483341 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.483321    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:42.488956 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.488935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txk4\" (UniqueName: \"kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.799345 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.799305    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:42.901338 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.901295    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:42.984994 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.984960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.987549 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.987524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") pod \"maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:42.999207 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:42.999152    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:43.222588 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:43.222556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:43.367114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:43.367089    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:42:43.369729 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:42:43.369696    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa48ec82_ed0c_4766_8364_c54be9ae97c6.slice/crio-782e0c964353fdf305a40d3af5cca6c1a66b058c3f236185e383746976fa0f3c WatchSource:0}: Error finding container 782e0c964353fdf305a40d3af5cca6c1a66b058c3f236185e383746976fa0f3c: Status 404 returned error can't find the container with id 782e0c964353fdf305a40d3af5cca6c1a66b058c3f236185e383746976fa0f3c
Jul 27 19:42:44.084156 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:44.084057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" event={"ID":"aa48ec82-ed0c-4766-8364-c54be9ae97c6","Type":"ContainerStarted","Data":"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"}
Jul 27 19:42:44.084156 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:44.084109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" event={"ID":"aa48ec82-ed0c-4766-8364-c54be9ae97c6","Type":"ContainerStarted","Data":"782e0c964353fdf305a40d3af5cca6c1a66b058c3f236185e383746976fa0f3c"}
Jul 27 19:42:44.084631 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:44.084385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:44.100903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:44.100849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" podStartSLOduration=1.6650712429999999 podStartE2EDuration="2.10083136s" totalImagesPullingTime="435.760117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:44.098777379 +0000 UTC m=+2244.786641820" watchObservedRunningTime="2026-07-27 19:42:44.10083136 +0000 UTC m=+2244.788695795"
Jul 27 19:42:46.661165 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:46.661114    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:42:50.094845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:50.094812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:42:57.700992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:57.700858    2560 patch_prober.go:28] interesting pod/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:59720->10.134.0.41:15021: read: connection reset by peer" start-of-body=
Jul 27 19:42:57.700992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:57.700928    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:59720->10.134.0.41:15021: read: connection reset by peer"
Jul 27 19:42:58.160596 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.160563    2560 generic.go:356] "Generic (PLEG): container finished" podID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerID="f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2" exitCode=0
Jul 27 19:42:58.160779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.160632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerDied","Data":"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"}
Jul 27 19:42:58.161006 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.160993    2560 scope.go:117] "RemoveContainer" containerID="f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"
Jul 27 19:42:58.161991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.161962    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:58.162088 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.162044    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:58.162152 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:58.162091    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:42:59.168110 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:59.168072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerStarted","Data":"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"}
Jul 27 19:42:59.812270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:59.812213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:42:59.812582 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:59.812365    2560 patch_prober.go:28] interesting pod/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:42:59.812750 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:42:59.812726    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 27 19:43:00.812740 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:00.812693    2560 patch_prober.go:28] interesting pod/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:43:00.813273 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:00.812762    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 27 19:43:01.812028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:01.811983    2560 patch_prober.go:28] interesting pod/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:43:01.812348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:01.812317    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 27 19:43:02.812592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:02.812551    2560 patch_prober.go:28] interesting pod/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 27 19:43:02.813192 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:02.813157    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 27 19:43:03.815895 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:03.815859    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:43:03.816316 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:03.816278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:43:03.817089 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:03.817064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:43:10.585027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.584994    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:43:10.585479 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.585201    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" podUID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" containerName="maas-api" containerID="cri-o://3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8" gracePeriod=30
Jul 27 19:43:10.615734 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.615705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:10.689160 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.689128    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:10.747554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.747524    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:10.808640 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.808594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:10.837804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.837741    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:43:10.940351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.940315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls\") pod \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") "
Jul 27 19:43:10.940554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.940360    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca\") pod \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") "
Jul 27 19:43:10.940554 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.940496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lklch\" (UniqueName: \"kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch\") pod \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\" (UID: \"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e\") "
Jul 27 19:43:10.940737 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.940693    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" (UID: "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:10.940831 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.940804    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:10.942655 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.942633    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch" (OuterVolumeSpecName: "kube-api-access-lklch") pod "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" (UID: "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e"). InnerVolumeSpecName "kube-api-access-lklch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:10.942755 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:10.942669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" (UID: "6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:43:11.042264 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.042228    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.042440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.042280    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lklch\" (UniqueName: \"kubernetes.io/projected/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e-kube-api-access-lklch\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:11.202979 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.202945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:11.219914 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.219881    2560 generic.go:356] "Generic (PLEG): container finished" podID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" containerID="3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8" exitCode=0
Jul 27 19:43:11.220061 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.219930    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"
Jul 27 19:43:11.220061 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.219956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" event={"ID":"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e","Type":"ContainerDied","Data":"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"}
Jul 27 19:43:11.220061 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.220024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc" event={"ID":"6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e","Type":"ContainerDied","Data":"7aa150a331004bf7ded6199696cf2d1d4a3f28db55bc660dad1f1cd3ad03a0e9"}
Jul 27 19:43:11.220061 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.220046    2560 scope.go:117] "RemoveContainer" containerID="3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"
Jul 27 19:43:11.228856 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.228813    2560 scope.go:117] "RemoveContainer" containerID="3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"
Jul 27 19:43:11.229121 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:11.229102    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8\": container with ID starting with 3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8 not found: ID does not exist" containerID="3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"
Jul 27 19:43:11.229192 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.229125    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8"} err="failed to get container status \"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8\": rpc error: code = NotFound desc = could not find container \"3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8\": container with ID starting with 3b5835ecda857c292ce9db6ca2f424cadda8242a731286f31b78c323c558e7f8 not found: ID does not exist"
Jul 27 19:43:11.240925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.240905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:43:11.246504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.246484    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-944fa0-546b5cbd48-cd7wc"]
Jul 27 19:43:11.781294 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:11.781243    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" path="/var/lib/kubelet/pods/6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e/volumes"
Jul 27 19:43:17.122652 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:17.122613    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:17.220835 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:17.220794    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:17.435647 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:17.435552    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:17.638545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:17.638503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:33.215878 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.215844    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:43:33.216451 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.216135    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" podUID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" containerName="maas-api" containerID="cri-o://77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524" gracePeriod=30
Jul 27 19:43:33.242698 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.242666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:33.323122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.323089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:33.408307 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.408268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:33.462127 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.462100    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:43:33.483972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.483879    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:33.545349 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.545320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txk4\" (UniqueName: \"kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4\") pod \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") "
Jul 27 19:43:33.545544 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.545379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca\") pod \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") "
Jul 27 19:43:33.545544 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.545423    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") pod \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\" (UID: \"aa48ec82-ed0c-4766-8364-c54be9ae97c6\") "
Jul 27 19:43:33.545948 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.545912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa48ec82-ed0c-4766-8364-c54be9ae97c6" (UID: "aa48ec82-ed0c-4766-8364-c54be9ae97c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:33.547935 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.547909    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa48ec82-ed0c-4766-8364-c54be9ae97c6" (UID: "aa48ec82-ed0c-4766-8364-c54be9ae97c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:43:33.548028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.547980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4" (OuterVolumeSpecName: "kube-api-access-8txk4") pod "aa48ec82-ed0c-4766-8364-c54be9ae97c6" (UID: "aa48ec82-ed0c-4766-8364-c54be9ae97c6"). InnerVolumeSpecName "kube-api-access-8txk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:33.646993 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.646955    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa48ec82-ed0c-4766-8364-c54be9ae97c6-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.646993 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.646990    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txk4\" (UniqueName: \"kubernetes.io/projected/aa48ec82-ed0c-4766-8364-c54be9ae97c6-kube-api-access-8txk4\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.646993 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.647001    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa48ec82-ed0c-4766-8364-c54be9ae97c6-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.844002 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:33.843968    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:34.327628 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.327592    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" containerID="77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524" exitCode=0
Jul 27 19:43:34.328050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.327638    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"
Jul 27 19:43:34.328050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.327683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" event={"ID":"aa48ec82-ed0c-4766-8364-c54be9ae97c6","Type":"ContainerDied","Data":"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"}
Jul 27 19:43:34.328050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.327732    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m" event={"ID":"aa48ec82-ed0c-4766-8364-c54be9ae97c6","Type":"ContainerDied","Data":"782e0c964353fdf305a40d3af5cca6c1a66b058c3f236185e383746976fa0f3c"}
Jul 27 19:43:34.328050 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.327754    2560 scope.go:117] "RemoveContainer" containerID="77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"
Jul 27 19:43:34.336850 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.336833    2560 scope.go:117] "RemoveContainer" containerID="77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"
Jul 27 19:43:34.337152 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:34.337132    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524\": container with ID starting with 77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524 not found: ID does not exist" containerID="77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"
Jul 27 19:43:34.337204 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.337161    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524"} err="failed to get container status \"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524\": rpc error: code = NotFound desc = could not find container \"77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524\": container with ID starting with 77fc3e2c1a86e264df203e112971d99d70349e891dd8da7dac27f3fc24be6524 not found: ID does not exist"
Jul 27 19:43:34.359652 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.359618    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:43:34.367619 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:34.367595    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-74909c-7d9d567f7f-2h26m"]
Jul 27 19:43:35.781947 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:35.781918    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" path="/var/lib/kubelet/pods/aa48ec82-ed0c-4766-8364-c54be9ae97c6/volumes"
Jul 27 19:43:39.684556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:39.684518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:39.769071 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:39.769037    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:39.938885 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:39.938806    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:43:39.939081 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:39.939039    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy" containerID="cri-o://0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e" gracePeriod=30
Jul 27 19:43:39.964497 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:39.964462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:40.210524 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:40.210435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:40.589715 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:40.589620    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:40.918702 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:40.918667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:41.013464 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:41.013430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:43.682405 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.682363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:43.813772 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.813741    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:43:43.814210 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814197    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" containerName="maas-api"
Jul 27 19:43:43.814270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814214    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" containerName="maas-api"
Jul 27 19:43:43.814270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" containerName="maas-api"
Jul 27 19:43:43.814270 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814239    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" containerName="maas-api"
Jul 27 19:43:43.814383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814330    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa48ec82-ed0c-4766-8364-c54be9ae97c6" containerName="maas-api"
Jul 27 19:43:43.814383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.814342    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aaad9a2-4cfc-4ab0-bb23-69e106f35b6e" containerName="maas-api"
Jul 27 19:43:43.815674 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.815651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:43.817419 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.817402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:43.819978 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:43.819945    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:43.820340 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:43.820311    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-shared-a-b4cd12-serving-cert\" is forbidden: User \"system:node:ip-10-0-140-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-140-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b4cd12-serving-cert\"" type="*v1.Secret"
Jul 27 19:43:43.849042 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.849006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:43:43.936576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.936486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:43.936576 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.936545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnbm7\" (UniqueName: \"kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:43.936766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.936647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:43.967165 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:43.967123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:44.038041 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.037998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:44.038209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.038059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbm7\" (UniqueName: \"kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:44.038209 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.038107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:44.038752 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.038732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:44.048921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.048899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbm7\" (UniqueName: \"kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:44.507122 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.507088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:44.602545 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.602484    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:44.813701 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.813615    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b4cd12-serving-cert\""
Jul 27 19:43:44.821216 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:44.821192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls\") pod \"maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:45.027707 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.027674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:45.191886 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.191858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:43:45.194655 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:43:45.194623    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05e7694_028f_498e_90f1_cdb221c7a1b7.slice/crio-73423e815f68d82643db9b47c42e5aa8ab9681f2085990f337c6e047b2b0e46a WatchSource:0}: Error finding container 73423e815f68d82643db9b47c42e5aa8ab9681f2085990f337c6e047b2b0e46a: Status 404 returned error can't find the container with id 73423e815f68d82643db9b47c42e5aa8ab9681f2085990f337c6e047b2b0e46a
Jul 27 19:43:45.210123 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.210098    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:43:45.348878 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.348780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.348878 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.348824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.348878 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.348851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.348878 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.348879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.348908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79bsl\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:45.349594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs\") pod \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\" (UID: \"3dc01930-0e6f-498d-b7f7-1ddeee1753ca\") "
Jul 27 19:43:45.349594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:45.349594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349352    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:45.349594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349556    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.349594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349586    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.350008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349612    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.350008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:45.350008 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.349977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:45.351586 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.351558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:45.351753 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.351558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl" (OuterVolumeSpecName: "kube-api-access-79bsl") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "kube-api-access-79bsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:45.351753 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.351677    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:43:45.351869 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.351758    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3dc01930-0e6f-498d-b7f7-1ddeee1753ca" (UID: "3dc01930-0e6f-498d-b7f7-1ddeee1753ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:43:45.376281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.376230    2560 generic.go:356] "Generic (PLEG): container finished" podID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerID="0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e" exitCode=0
Jul 27 19:43:45.376420 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.376282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerDied","Data":"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"}
Jul 27 19:43:45.376420 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.376306    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"
Jul 27 19:43:45.376420 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.376333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp" event={"ID":"3dc01930-0e6f-498d-b7f7-1ddeee1753ca","Type":"ContainerDied","Data":"e3134b644541e00dc79a7c3c92057ea14e3bd4ed67bf6caede9376acf3bdfcc2"}
Jul 27 19:43:45.376420 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.376355    2560 scope.go:117] "RemoveContainer" containerID="0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"
Jul 27 19:43:45.377604 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.377579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" event={"ID":"a05e7694-028f-498e-90f1-cdb221c7a1b7","Type":"ContainerStarted","Data":"73423e815f68d82643db9b47c42e5aa8ab9681f2085990f337c6e047b2b0e46a"}
Jul 27 19:43:45.385654 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.385640    2560 scope.go:117] "RemoveContainer" containerID="f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"
Jul 27 19:43:45.393833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.393818    2560 scope.go:117] "RemoveContainer" containerID="0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"
Jul 27 19:43:45.394100 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:45.394082    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e\": container with ID starting with 0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e not found: ID does not exist" containerID="0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"
Jul 27 19:43:45.394143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.394110    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e"} err="failed to get container status \"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e\": rpc error: code = NotFound desc = could not find container \"0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e\": container with ID starting with 0a890a7c75c51e97bab108d08c1fcd7070a4fc2942523fae96865e0092c04c9e not found: ID does not exist"
Jul 27 19:43:45.394143 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.394127    2560 scope.go:117] "RemoveContainer" containerID="f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"
Jul 27 19:43:45.394413 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:45.394389    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2\": container with ID starting with f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2 not found: ID does not exist" containerID="f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"
Jul 27 19:43:45.394473 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.394422    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2"} err="failed to get container status \"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2\": rpc error: code = NotFound desc = could not find container \"f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2\": container with ID starting with f7bc06d4ad2864d999c915de436e2bbf8c3b4566ba44b5e9cedc2cef6c11eaf2 not found: ID does not exist"
Jul 27 19:43:45.397926 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.397905    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:43:45.407537 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.407518    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-74909c-openshift-default-6fcf994f9d-pd7tp"]
Jul 27 19:43:45.450440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450388    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.450440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450416    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.450440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450431    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.450440 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450443    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.450731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450450    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.450731 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.450458    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79bsl\" (UniqueName: \"kubernetes.io/projected/3dc01930-0e6f-498d-b7f7-1ddeee1753ca-kube-api-access-79bsl\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:43:45.782336 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:45.782304    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" path="/var/lib/kubelet/pods/3dc01930-0e6f-498d-b7f7-1ddeee1753ca/volumes"
Jul 27 19:43:46.385243 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:46.385212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" event={"ID":"a05e7694-028f-498e-90f1-cdb221c7a1b7","Type":"ContainerStarted","Data":"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"}
Jul 27 19:43:46.385660 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:46.385308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:46.403156 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:46.403105    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" podStartSLOduration=3.033907074 podStartE2EDuration="3.40308811s" totalImagesPullingTime="369.181036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:46.401760769 +0000 UTC m=+2307.089625211" watchObservedRunningTime="2026-07-27 19:43:46.40308811 +0000 UTC m=+2307.090952611"
Jul 27 19:43:48.262519 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.262487    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:48.626470 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.626434    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:48.927859 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.927783    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:43:48.928102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928089    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.928148 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928104    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.928148 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928116    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.928148 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928122    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.928258 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928178    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.928258 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.928188    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc01930-0e6f-498d-b7f7-1ddeee1753ca" containerName="istio-proxy"
Jul 27 19:43:48.930166 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.930151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:48.934933 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.934914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-70aa40-openshift-default-dockercfg-6bn58\""
Jul 27 19:43:48.944365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.944337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:43:48.963199 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:48.963167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:49.048811 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.048777    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:49.083266 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083454 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083454 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47lf6\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083454 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083454 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083687 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083687 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083687 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.083687 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.083652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184516 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47lf6\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.184806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.185107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.185107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.184893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.185107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.185054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.185107 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.185078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.185364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.185347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.187213 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.187188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.187445 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.187425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.193221 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.193201    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.193348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.193313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47lf6\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6\") pod \"e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") " pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.242364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.242332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:49.379273 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.379221    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:43:49.381318 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:43:49.381292    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cddf89_12f4_47f3_9e54_effff04f33a3.slice/crio-5ce96f547c527823feb2551e8e23064929cfcdfb65a0b6c0fb61571e28f8ee69 WatchSource:0}: Error finding container 5ce96f547c527823feb2551e8e23064929cfcdfb65a0b6c0fb61571e28f8ee69: Status 404 returned error can't find the container with id 5ce96f547c527823feb2551e8e23064929cfcdfb65a0b6c0fb61571e28f8ee69
Jul 27 19:43:49.383609 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.383577    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:49.383692 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.383642    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:49.383692 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.383672    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:43:49.400411 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:49.400384    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerStarted","Data":"5ce96f547c527823feb2551e8e23064929cfcdfb65a0b6c0fb61571e28f8ee69"}
Jul 27 19:43:50.405748 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:50.405716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerStarted","Data":"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"}
Jul 27 19:43:50.428895 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:50.428847    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podStartSLOduration=2.428831272 podStartE2EDuration="2.428831272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:50.426661987 +0000 UTC m=+2311.114526446" watchObservedRunningTime="2026-07-27 19:43:50.428831272 +0000 UTC m=+2311.116695713"
Jul 27 19:43:51.243344 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:51.243306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:51.248194 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:51.248164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:51.410031 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:51.409998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:51.411161 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:51.411138    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:43:52.394739 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.394714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:43:52.511027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.510995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:52.606290 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.606237    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:43:52.606994 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.606960    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:52.608794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.608778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.610902 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.610870    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-70aa40-serving-cert\""
Jul 27 19:43:52.621219 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.621191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:43:52.682183 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.682092    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:52.717099 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.717061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfkt\" (UniqueName: \"kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.717382 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.717149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.717382 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.717174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.818241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.818197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfkt\" (UniqueName: \"kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.818460 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.818322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.818460 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.818350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.818600 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:52.818466    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-serving-cert: secret "maas-api-e2e-shared-b-70aa40-serving-cert" not found
Jul 27 19:43:52.818600 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:43:52.818532    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls podName:80944007-62d1-4541-88af-ad155525b3dd nodeName:}" failed. No retries permitted until 2026-07-27 19:43:53.318514454 +0000 UTC m=+2314.006378876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls") pod "maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" (UID: "80944007-62d1-4541-88af-ad155525b3dd") : secret "maas-api-e2e-shared-b-70aa40-serving-cert" not found
Jul 27 19:43:52.819215 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.819189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:52.829436 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:52.829417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfkt\" (UniqueName: \"kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:53.046525 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.046433    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:53.226448 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.226415    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:53.323220 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.323133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:53.324753 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.324729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:43:53.325763 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.325737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") pod \"maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:53.521611 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.521573    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:53.669306 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:53.663028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:43:54.425564 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:54.425531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" event={"ID":"80944007-62d1-4541-88af-ad155525b3dd","Type":"ContainerStarted","Data":"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"}
Jul 27 19:43:54.425779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:54.425584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" event={"ID":"80944007-62d1-4541-88af-ad155525b3dd","Type":"ContainerStarted","Data":"b66750829d02751423bdf6c4b55c9cd3773a6ac1575cfb6b769c1594d46d73e8"}
Jul 27 19:43:54.425779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:54.425634    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:43:54.445094 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:54.445040    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" podStartSLOduration=2.137109084 podStartE2EDuration="2.445025696s" totalImagesPullingTime="307.916612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:54.442838798 +0000 UTC m=+2315.130703241" watchObservedRunningTime="2026-07-27 19:43:54.445025696 +0000 UTC m=+2315.132890136"
Jul 27 19:43:56.956653 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:43:56.956616    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:44:00.436756 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:00.436719    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:44:06.411271 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.411215    2560 patch_prober.go:28] interesting pod/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 27 19:44:06.411717 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.411295    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 27 19:44:06.484890 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.484851    2560 generic.go:356] "Generic (PLEG): container finished" podID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerID="032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc" exitCode=0
Jul 27 19:44:06.485080 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.484920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerDied","Data":"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"}
Jul 27 19:44:06.485366 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.485352    2560 scope.go:117] "RemoveContainer" containerID="032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"
Jul 27 19:44:06.486577 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.486548    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:44:06.486669 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.486628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:44:06.486669 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:06.486662    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:44:07.491543 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:07.491502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerStarted","Data":"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"}
Jul 27 19:44:08.243498 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:08.243452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:44:08.243722 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:08.243680    2560 patch_prober.go:28] interesting pod/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 27 19:44:08.243818 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:08.243742    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 27 19:44:09.242903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:09.242859    2560 patch_prober.go:28] interesting pod/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 27 19:44:09.243379 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:09.242933    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 27 19:44:10.171175 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:10.171135    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:44:10.242895 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:10.242843    2560 patch_prober.go:28] interesting pod/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 27 19:44:10.243114 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:10.242914    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 27 19:44:11.242909 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:11.242817    2560 patch_prober.go:28] interesting pod/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 27 19:44:11.242909 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:11.242881    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 27 19:44:12.248013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:12.247976    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:44:12.248508 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:12.248380    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:44:12.249433 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:12.249409    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:44:15.320438 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:15.320404    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:44:40.682778 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:40.682738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:44:54.077804 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:44:54.077767    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:21.417892 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:45:21.417849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:45:21.475213 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:45:21.475174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:02.404831 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:02.404792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:15.946675 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:15.946630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:16.003150 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:16.003107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:46.929512 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:46.929474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:47.779147 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:47.779105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:59.742845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.742794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:49:59.746475 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.746448    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.749088 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.749060    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"default-dockercfg-5x47d\""
Jul 27 19:49:59.749283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.749113    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"openshift-service-ca.crt\""
Jul 27 19:49:59.749937 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.749922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"kube-root-ca.crt\""
Jul 27 19:49:59.750305 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.750289    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"sub-test-model-b4cd12-kserve-self-signed-certs\""
Jul 27 19:49:59.760149 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.760114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:49:59.769477 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.769442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:49:59.859231 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.859231 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcr4g\" (UniqueName: \"kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.859538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.859538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.859538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.859538 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.859467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960380 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcr4g\" (UniqueName: \"kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960777 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960820 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.960944 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.960916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.961518 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.961494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.961704 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.961510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.963442 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.963416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.963552 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.963534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:49:59.969895 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:49:59.969867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcr4g\" (UniqueName: \"kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g\") pod \"sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") " pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:00.056617 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:00.056511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:00.199073 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:00.199044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:50:00.201347 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:50:00.201318    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3b8cd20_d267_472c_ac2d_50e1d2de4e4b.slice/crio-ad5f357d8c0023efb24ac3036fafadaa5c80ac8467bf8a2aab7143fa299a6209 WatchSource:0}: Error finding container ad5f357d8c0023efb24ac3036fafadaa5c80ac8467bf8a2aab7143fa299a6209: Status 404 returned error can't find the container with id ad5f357d8c0023efb24ac3036fafadaa5c80ac8467bf8a2aab7143fa299a6209
Jul 27 19:50:01.171984 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:01.171947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" event={"ID":"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b","Type":"ContainerStarted","Data":"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"}
Jul 27 19:50:01.172408 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:01.171993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" event={"ID":"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b","Type":"ContainerStarted","Data":"ad5f357d8c0023efb24ac3036fafadaa5c80ac8467bf8a2aab7143fa299a6209"}
Jul 27 19:50:01.192030 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:01.191978    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" podStartSLOduration=2.1919587209999998 podStartE2EDuration="2.191958721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:49:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:50:01.189762095 +0000 UTC m=+2681.877626535" watchObservedRunningTime="2026-07-27 19:50:01.191958721 +0000 UTC m=+2681.879823160"
Jul 27 19:50:10.057058 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:10.057009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:10.057058 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:10.057064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:10.070064 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:10.070028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:10.228410 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:10.228374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:50:21.367142 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:50:21.367047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:39.078855 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:39.078807    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:51:39.097054 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:39.097020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:39.405177 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:39.405147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:40.086988 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:40.086946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:48.478920 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:48.478831    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:51:54.099017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.098972    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" podUID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" containerName="main" containerID="cri-o://7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c" gracePeriod=45
Jul 27 19:51:54.349436 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.349366    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:51:54.522059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522067    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522171    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522211    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcr4g\" (UniqueName: \"kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522316    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir\") pod \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\" (UID: \"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b\") "
Jul 27 19:51:54.522541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522399    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:54.522541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522416    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home" (OuterVolumeSpecName: "home") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:54.522613 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:54.522679 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522615    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-home\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.522679 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.522630    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-model-cache\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.524608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.524574    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm" (OuterVolumeSpecName: "dshm") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:54.524608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.524582    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:51:54.524759 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.524616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g" (OuterVolumeSpecName: "kube-api-access-lcr4g") pod "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" (UID: "c3b8cd20-d267-472c-ac2d-50e1d2de4e4b"). InnerVolumeSpecName "kube-api-access-lcr4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:51:54.623695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.623660    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tls-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.623695 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.623694    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-dshm\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.623888 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.623705    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcr4g\" (UniqueName: \"kubernetes.io/projected/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-kube-api-access-lcr4g\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.623888 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.623714    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b-tmp-dir\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:51:54.692206 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.692165    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" containerID="7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c" exitCode=0
Jul 27 19:51:54.692384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.692224    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"
Jul 27 19:51:54.692384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.692266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" event={"ID":"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b","Type":"ContainerDied","Data":"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"}
Jul 27 19:51:54.692384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.692313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855" event={"ID":"c3b8cd20-d267-472c-ac2d-50e1d2de4e4b","Type":"ContainerDied","Data":"ad5f357d8c0023efb24ac3036fafadaa5c80ac8467bf8a2aab7143fa299a6209"}
Jul 27 19:51:54.692384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.692336    2560 scope.go:117] "RemoveContainer" containerID="7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"
Jul 27 19:51:54.701555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.701536    2560 scope.go:117] "RemoveContainer" containerID="7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"
Jul 27 19:51:54.701813 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:51:54.701794    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c\": container with ID starting with 7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c not found: ID does not exist" containerID="7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"
Jul 27 19:51:54.701880 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.701821    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c"} err="failed to get container status \"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c\": rpc error: code = NotFound desc = could not find container \"7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c\": container with ID starting with 7760a75bb561c52c343315af046a2d34905ea0a1ae18dc689703957878e7299c not found: ID does not exist"
Jul 27 19:51:54.712144 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.712119    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:51:54.716208 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:54.716185    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/sub-test-model-b4cd12-kserve-6bdb4bf95f-tj855"]
Jul 27 19:51:55.781724 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:51:55.781682    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" path="/var/lib/kubelet/pods/c3b8cd20-d267-472c-ac2d-50e1d2de4e4b/volumes"
Jul 27 19:52:29.684776 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:52:29.684736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:36.439940 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:36.439853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:37.053016 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:37.052982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:37.861027 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:37.860989    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:57.056727 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:57.056688    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:57.392343 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:57.392312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:53:57.752384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:53:57.752296    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:00.559497 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.559461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:00.647833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.647797    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:54:00.648351 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.648335    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" containerName="main"
Jul 27 19:54:00.648404 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.648355    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" containerName="main"
Jul 27 19:54:00.648447 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.648430    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b8cd20-d267-472c-ac2d-50e1d2de4e4b" containerName="main"
Jul 27 19:54:00.651693 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.651675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.653712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.653686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:00.653903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.653891    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-f227a8-serving-cert\""
Jul 27 19:54:00.662521 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.662500    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:54:00.696686 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.696651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.696840 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.696709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv78\" (UniqueName: \"kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.696840 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.696762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.718063 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.718031    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:00.797467 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.797429    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.797674 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.797491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv78\" (UniqueName: \"kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.797674 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.797541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.797674 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:54:00.797583    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-serving-cert: secret "maas-api-e2e-ipp-a-f227a8-serving-cert" not found
Jul 27 19:54:00.797858 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:54:00.797679    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls podName:72482039-5c0d-4536-b843-b605088e40ff nodeName:}" failed. No retries permitted until 2026-07-27 19:54:01.297662876 +0000 UTC m=+2921.985527294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls") pod "maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" (UID: "72482039-5c0d-4536-b843-b605088e40ff") : secret "maas-api-e2e-ipp-a-f227a8-serving-cert" not found
Jul 27 19:54:00.798412 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.798392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:00.808557 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:00.808532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv78\" (UniqueName: \"kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:01.236722 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.236691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:01.301468 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.301431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:01.303944 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.303927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") pod \"maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:01.395433 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.395398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:01.476211 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.476168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:01.563389 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.563306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:01.704190 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.704159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:54:01.705950 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:54:01.705922    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72482039_5c0d_4536_b843_b605088e40ff.slice/crio-bd4b09d901a08637cf66cff177b5cea46cba48de456a5522a642ce429899fe08 WatchSource:0}: Error finding container bd4b09d901a08637cf66cff177b5cea46cba48de456a5522a642ce429899fe08: Status 404 returned error can't find the container with id bd4b09d901a08637cf66cff177b5cea46cba48de456a5522a642ce429899fe08
Jul 27 19:54:01.707296 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:01.707280    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:54:02.262564 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:02.262525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" event={"ID":"72482039-5c0d-4536-b843-b605088e40ff","Type":"ContainerStarted","Data":"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"}
Jul 27 19:54:02.262723 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:02.262597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:02.262723 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:02.262620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" event={"ID":"72482039-5c0d-4536-b843-b605088e40ff","Type":"ContainerStarted","Data":"bd4b09d901a08637cf66cff177b5cea46cba48de456a5522a642ce429899fe08"}
Jul 27 19:54:02.278533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:02.278491    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" podStartSLOduration=1.7912666339999999 podStartE2EDuration="2.278471559s" totalImagesPullingTime="487.204925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:02.278018971 +0000 UTC m=+2922.965883424" watchObservedRunningTime="2026-07-27 19:54:02.278471559 +0000 UTC m=+2922.966335999"
Jul 27 19:54:05.089696 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:05.089656    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:08.272583 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:08.272554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:54:16.084566 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:16.084442    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:16.446633 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:16.446597    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:16.703897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:16.703784    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:19.732596 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.732544    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:19.823241 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.823195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:19.856310 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.856280    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:54:19.859640 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.859615    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:19.861954 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.861930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b78801-serving-cert\""
Jul 27 19:54:19.871218 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.871189    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:54:19.921483 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.921455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:19.960217 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.959881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:19.960217 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.959999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qld\" (UniqueName: \"kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:19.960217 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:19.960155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.061651 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.061561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.061651 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.061601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qld\" (UniqueName: \"kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.061848 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.061662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.062397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.062376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.064236 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.064206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.070893 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.070872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qld\" (UniqueName: \"kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld\") pod \"maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.075997 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.075972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:20.171363 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.171328    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:20.320971 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.320483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:54:20.323310 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:54:20.323276    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133c6e78_0244_49c3_a8b6_a248c04a33b0.slice/crio-0723ac9fbba8f2223c2d2b2b8cff687214d24c3fcc04d5805d0d5b086e5daba4 WatchSource:0}: Error finding container 0723ac9fbba8f2223c2d2b2b8cff687214d24c3fcc04d5805d0d5b086e5daba4: Status 404 returned error can't find the container with id 0723ac9fbba8f2223c2d2b2b8cff687214d24c3fcc04d5805d0d5b086e5daba4
Jul 27 19:54:20.352233 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.352198    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" event={"ID":"133c6e78-0244-49c3-a8b6-a248c04a33b0","Type":"ContainerStarted","Data":"0723ac9fbba8f2223c2d2b2b8cff687214d24c3fcc04d5805d0d5b086e5daba4"}
Jul 27 19:54:20.473714 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.473675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:20.570818 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:20.570731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:21.358448 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:21.358405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" event={"ID":"133c6e78-0244-49c3-a8b6-a248c04a33b0","Type":"ContainerStarted","Data":"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"}
Jul 27 19:54:21.358836 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:21.358480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:54:21.375398 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:21.375349    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" podStartSLOduration=1.863754731 podStartE2EDuration="2.37533368s" totalImagesPullingTime="511.578949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:21.373280523 +0000 UTC m=+2942.061144954" watchObservedRunningTime="2026-07-27 19:54:21.37533368 +0000 UTC m=+2942.063198150"
Jul 27 19:54:24.242985 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:24.242950    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:54:27.368578 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:54:27.368541    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:55:07.400666 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:07.400624    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:12.526876 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:12.526838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:18.333045 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:18.333002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:18.431397 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:18.431363    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:47.884743 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:47.884710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:48.260005 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.259925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:55:48.263333 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.263308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.265667 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.265648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3ff2a8-openshift-default-dockercfg-bd9z2\""
Jul 27 19:55:48.284322 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.284293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:55:48.305599 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.305572    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:48.355904 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.355860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.355937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.355969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356075 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356327 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356327 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356432 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.356432 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.356383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszjz\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457690 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457660    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457690 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszjz\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.457943 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.457895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.458371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.458111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.458371 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.458181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.458539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.458517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.458598 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.458536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.458598 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.458587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.460274 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.460238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.460563 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.460545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.466210 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.466184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.466342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.466293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszjz\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz\") pod \"e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") " pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.534233 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.534137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:48.574475 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.574437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:48.722762 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.722737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:55:48.725414 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:55:48.725388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9525f6_ff0c_46e6_b458_55fe765525e1.slice/crio-50311edb5c7ae2b81b5fcc2cac72c72b470dc62a0b86e22f9456f313cf395401 WatchSource:0}: Error finding container 50311edb5c7ae2b81b5fcc2cac72c72b470dc62a0b86e22f9456f313cf395401: Status 404 returned error can't find the container with id 50311edb5c7ae2b81b5fcc2cac72c72b470dc62a0b86e22f9456f313cf395401
Jul 27 19:55:48.727732 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.727699    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:55:48.727825 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.727767    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:55:48.727825 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.727794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:55:48.772340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:48.772307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerStarted","Data":"50311edb5c7ae2b81b5fcc2cac72c72b470dc62a0b86e22f9456f313cf395401"}
Jul 27 19:55:49.781980 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:49.781944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerStarted","Data":"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"}
Jul 27 19:55:49.809879 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:49.809834    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podStartSLOduration=1.8098184590000002 podStartE2EDuration="1.809818459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:49.804879864 +0000 UTC m=+3030.492744304" watchObservedRunningTime="2026-07-27 19:55:49.809818459 +0000 UTC m=+3030.497682943"
Jul 27 19:55:50.574757 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:50.574721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:50.579780 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:50.579755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:50.784182 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:50.784146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:50.785307 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:50.785286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:55:51.841622 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:51.841580    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:51.947357 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:51.947323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:52.794946 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:52.794912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:53.103800 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:53.103716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:53.268482 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:53.268407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:53.366476 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:53.366386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:55:56.389039 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:55:56.388998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:05.883012 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:05.882979    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:47804->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Jul 27 19:56:05.883442 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:05.883064    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:47804->10.134.0.49:15021: read: connection reset by peer"
Jul 27 19:56:06.862806 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.862771    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerID="8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764" exitCode=0
Jul 27 19:56:06.862991 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.862834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerDied","Data":"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"}
Jul 27 19:56:06.863364 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.863347    2560 scope.go:117] "RemoveContainer" containerID="8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"
Jul 27 19:56:06.864492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.864459    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:56:06.864548 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.864536    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:56:06.864584 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:06.864568    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:56:07.869972 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:07.869934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerStarted","Data":"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"}
Jul 27 19:56:08.575664 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:08.575622    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:08.575853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:08.575811    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 27 19:56:08.575903 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:08.575865    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 27 19:56:09.575409 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:09.575370    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 27 19:56:09.575776 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:09.575437    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 27 19:56:10.575242 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:10.575205    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 27 19:56:10.575448 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:10.575304    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 27 19:56:11.575146 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:11.575113    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 27 19:56:11.575342 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:11.575168    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 27 19:56:12.578814 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:12.578782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:12.579214 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:12.579153    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:12.579963 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:12.579945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:27.858504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:27.858462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:27.958786 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:27.958758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:28.036439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:28.036402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:28.423452 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:28.423417    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:35.053905 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.053865    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:35.193130 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.193095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:35.399923 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.399892    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:56:35.400136 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.400109    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy" containerID="cri-o://89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf" gracePeriod=30
Jul 27 19:56:35.425384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.425359    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:35.631549 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:35.631517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:40.656368 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.656344    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:40.827729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827626    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.827729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bszjz\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.827729 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827748    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827812    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827879    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828028 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.827907    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy\") pod \"4d9525f6-ff0c-46e6-b458-55fe765525e1\" (UID: \"4d9525f6-ff0c-46e6-b458-55fe765525e1\") "
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828089    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828214    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828231    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.828365 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828319    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:40.828843 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.828616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:40.830182 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.830149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz" (OuterVolumeSpecName: "kube-api-access-bszjz") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "kube-api-access-bszjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:40.830353 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.830328    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:40.830645 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.830630    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:40.830705 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.830636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d9525f6-ff0c-46e6-b458-55fe765525e1" (UID: "4d9525f6-ff0c-46e6-b458-55fe765525e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:56:40.929589 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929559    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929589 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929586    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929589 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929595    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929603    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszjz\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-kube-api-access-bszjz\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929612    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9525f6-ff0c-46e6-b458-55fe765525e1-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929620    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:40.929809 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:40.929627    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9525f6-ff0c-46e6-b458-55fe765525e1-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:41.022068 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.022030    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerID="89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf" exitCode=0
Jul 27 19:56:41.022281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.022085    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"
Jul 27 19:56:41.022281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.022116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerDied","Data":"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"}
Jul 27 19:56:41.022281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.022178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8" event={"ID":"4d9525f6-ff0c-46e6-b458-55fe765525e1","Type":"ContainerDied","Data":"50311edb5c7ae2b81b5fcc2cac72c72b470dc62a0b86e22f9456f313cf395401"}
Jul 27 19:56:41.022281 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.022203    2560 scope.go:117] "RemoveContainer" containerID="89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"
Jul 27 19:56:41.031561 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.031546    2560 scope.go:117] "RemoveContainer" containerID="8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"
Jul 27 19:56:41.039680 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.039664    2560 scope.go:117] "RemoveContainer" containerID="89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"
Jul 27 19:56:41.039930 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:56:41.039911    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf\": container with ID starting with 89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf not found: ID does not exist" containerID="89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"
Jul 27 19:56:41.039981 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.039938    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf"} err="failed to get container status \"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf\": rpc error: code = NotFound desc = could not find container \"89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf\": container with ID starting with 89713c0f2164ecfd5d733d174897e1a115f17df3e4ac217c940047f3aa859caf not found: ID does not exist"
Jul 27 19:56:41.039981 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.039956    2560 scope.go:117] "RemoveContainer" containerID="8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"
Jul 27 19:56:41.040165 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:56:41.040146    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764\": container with ID starting with 8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764 not found: ID does not exist" containerID="8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"
Jul 27 19:56:41.040201 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.040172    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764"} err="failed to get container status \"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764\": rpc error: code = NotFound desc = could not find container \"8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764\": container with ID starting with 8ecb9b73969d9b6c2babd5935266ac82158270555bcca242390b3de9a284e764 not found: ID does not exist"
Jul 27 19:56:41.044178 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.044159    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:56:41.047328 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.047305    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3ff2a8-openshift-default-7788cf5868-98vl8"]
Jul 27 19:56:41.782109 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:41.782077    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" path="/var/lib/kubelet/pods/4d9525f6-ff0c-46e6-b458-55fe765525e1/volumes"
Jul 27 19:56:44.504899 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:44.504862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:44.605540 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:44.605509    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:56.441192 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.441154    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:56:56.441701 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.441390    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" podUID="72482039-5c0d-4536-b843-b605088e40ff" containerName="maas-api" containerID="cri-o://ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154" gracePeriod=30
Jul 27 19:56:56.513335 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.513304    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:56.704059 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.703995    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:56:56.722105 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.722070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:56.764492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.764461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzv78\" (UniqueName: \"kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78\") pod \"72482039-5c0d-4536-b843-b605088e40ff\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") "
Jul 27 19:56:56.764492 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.764498    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") pod \"72482039-5c0d-4536-b843-b605088e40ff\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") "
Jul 27 19:56:56.764739 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.764535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca\") pod \"72482039-5c0d-4536-b843-b605088e40ff\" (UID: \"72482039-5c0d-4536-b843-b605088e40ff\") "
Jul 27 19:56:56.764897 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.764874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72482039-5c0d-4536-b843-b605088e40ff" (UID: "72482039-5c0d-4536-b843-b605088e40ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:56.766717 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.766694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72482039-5c0d-4536-b843-b605088e40ff" (UID: "72482039-5c0d-4536-b843-b605088e40ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:56:56.766819 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.766762    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78" (OuterVolumeSpecName: "kube-api-access-kzv78") pod "72482039-5c0d-4536-b843-b605088e40ff" (UID: "72482039-5c0d-4536-b843-b605088e40ff"). InnerVolumeSpecName "kube-api-access-kzv78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:56.837531 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.837496    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:56.865862 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.865833    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72482039-5c0d-4536-b843-b605088e40ff-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:56.866000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.865864    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzv78\" (UniqueName: \"kubernetes.io/projected/72482039-5c0d-4536-b843-b605088e40ff-kube-api-access-kzv78\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:56.866000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.865881    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72482039-5c0d-4536-b843-b605088e40ff-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:56:56.952992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:56.952952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:57.099017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.098901    2560 generic.go:356] "Generic (PLEG): container finished" podID="72482039-5c0d-4536-b843-b605088e40ff" containerID="ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154" exitCode=0
Jul 27 19:56:57.099017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.098953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"
Jul 27 19:56:57.099017 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.098985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" event={"ID":"72482039-5c0d-4536-b843-b605088e40ff","Type":"ContainerDied","Data":"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"}
Jul 27 19:56:57.099336 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.099050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt" event={"ID":"72482039-5c0d-4536-b843-b605088e40ff","Type":"ContainerDied","Data":"bd4b09d901a08637cf66cff177b5cea46cba48de456a5522a642ce429899fe08"}
Jul 27 19:56:57.099336 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.099080    2560 scope.go:117] "RemoveContainer" containerID="ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"
Jul 27 19:56:57.108318 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.108295    2560 scope.go:117] "RemoveContainer" containerID="ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"
Jul 27 19:56:57.108595 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:56:57.108569    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154\": container with ID starting with ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154 not found: ID does not exist" containerID="ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"
Jul 27 19:56:57.108639 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.108611    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154"} err="failed to get container status \"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154\": rpc error: code = NotFound desc = could not find container \"ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154\": container with ID starting with ec362c1c47916febe73a1cc88f418ebd024c6e9b73940f4b2cca93eb1a188154 not found: ID does not exist"
Jul 27 19:56:57.121833 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.121810    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:56:57.132541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.132516    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-f227a8-5bf85b665c-nrhrt"]
Jul 27 19:56:57.392394 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.392349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:56:57.782099 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:56:57.782020    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72482039-5c0d-4536-b843-b605088e40ff" path="/var/lib/kubelet/pods/72482039-5c0d-4536-b843-b605088e40ff/volumes"
Jul 27 19:57:02.453179 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:02.453149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:40.203084 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:40.203045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:40.362189 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:40.362138    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:46.695999 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:46.695924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:52.475344 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:52.475312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:52.580807 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:52.580758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:52.790335 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:52.790228    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:57:53.038951 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:57:53.038916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:03.964434 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:03.964401    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:58:03.964845 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:03.964598    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" podUID="133c6e78-0244-49c3-a8b6-a248c04a33b0" containerName="maas-api" containerID="cri-o://ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4" gracePeriod=30
Jul 27 19:58:03.998439 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:03.998413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:04.112793 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.112750    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:04.207718 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.207693    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:58:04.231677 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.231599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:04.354071 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.354039    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca\") pod \"133c6e78-0244-49c3-a8b6-a248c04a33b0\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") "
Jul 27 19:58:04.354277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.354124    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls\") pod \"133c6e78-0244-49c3-a8b6-a248c04a33b0\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") "
Jul 27 19:58:04.354277 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.354149    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5qld\" (UniqueName: \"kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld\") pod \"133c6e78-0244-49c3-a8b6-a248c04a33b0\" (UID: \"133c6e78-0244-49c3-a8b6-a248c04a33b0\") "
Jul 27 19:58:04.354592 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.354565    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "133c6e78-0244-49c3-a8b6-a248c04a33b0" (UID: "133c6e78-0244-49c3-a8b6-a248c04a33b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:04.356504 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.356479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "133c6e78-0244-49c3-a8b6-a248c04a33b0" (UID: "133c6e78-0244-49c3-a8b6-a248c04a33b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:58:04.356600 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.356478    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld" (OuterVolumeSpecName: "kube-api-access-g5qld") pod "133c6e78-0244-49c3-a8b6-a248c04a33b0" (UID: "133c6e78-0244-49c3-a8b6-a248c04a33b0"). InnerVolumeSpecName "kube-api-access-g5qld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:04.398853 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.398819    2560 generic.go:356] "Generic (PLEG): container finished" podID="133c6e78-0244-49c3-a8b6-a248c04a33b0" containerID="ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4" exitCode=0
Jul 27 19:58:04.399000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.398865    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"
Jul 27 19:58:04.399000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.398903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" event={"ID":"133c6e78-0244-49c3-a8b6-a248c04a33b0","Type":"ContainerDied","Data":"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"}
Jul 27 19:58:04.399000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.398960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl" event={"ID":"133c6e78-0244-49c3-a8b6-a248c04a33b0","Type":"ContainerDied","Data":"0723ac9fbba8f2223c2d2b2b8cff687214d24c3fcc04d5805d0d5b086e5daba4"}
Jul 27 19:58:04.399000 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.398982    2560 scope.go:117] "RemoveContainer" containerID="ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"
Jul 27 19:58:04.408058 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.408033    2560 scope.go:117] "RemoveContainer" containerID="ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"
Jul 27 19:58:04.408344 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:58:04.408326    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4\": container with ID starting with ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4 not found: ID does not exist" containerID="ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"
Jul 27 19:58:04.408409 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.408352    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4"} err="failed to get container status \"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4\": rpc error: code = NotFound desc = could not find container \"ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4\": container with ID starting with ad8abd1133e22971fef90ff621a6e7abead728df050d342adb67c2146c0939d4 not found: ID does not exist"
Jul 27 19:58:04.421622 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.421597    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:58:04.427347 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.427325    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b78801-64c9674b9b-vfttl"]
Jul 27 19:58:04.451411 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.451386    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:04.454863 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.454845    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133c6e78-0244-49c3-a8b6-a248c04a33b0-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.454926 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.454866    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133c6e78-0244-49c3-a8b6-a248c04a33b0-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.454926 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.454877    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5qld\" (UniqueName: \"kubernetes.io/projected/133c6e78-0244-49c3-a8b6-a248c04a33b0-kube-api-access-g5qld\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.948097 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:04.948063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:05.781384 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:05.781350    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133c6e78-0244-49c3-a8b6-a248c04a33b0" path="/var/lib/kubelet/pods/133c6e78-0244-49c3-a8b6-a248c04a33b0/volumes"
Jul 27 19:58:11.138712 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:11.138679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.211594 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:11.211563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.448286 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:11.448195    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:11.681509 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:11.681478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:19.620240 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:19.620206    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:22.435507 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.435474    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:58:22.435925 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.435717    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" containerName="maas-api" containerID="cri-o://1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985" gracePeriod=30
Jul 27 19:58:22.482428 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.482399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:22.575768 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.575691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:22.673158 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.673110    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:22.690787 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.690723    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:58:22.766210 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.766172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:22.814546 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.814519    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls\") pod \"a05e7694-028f-498e-90f1-cdb221c7a1b7\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") "
Jul 27 19:58:22.814697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.814559    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnbm7\" (UniqueName: \"kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7\") pod \"a05e7694-028f-498e-90f1-cdb221c7a1b7\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") "
Jul 27 19:58:22.814697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.814577    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca\") pod \"a05e7694-028f-498e-90f1-cdb221c7a1b7\" (UID: \"a05e7694-028f-498e-90f1-cdb221c7a1b7\") "
Jul 27 19:58:22.814992 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.814966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a05e7694-028f-498e-90f1-cdb221c7a1b7" (UID: "a05e7694-028f-498e-90f1-cdb221c7a1b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:22.816813 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.816782    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a05e7694-028f-498e-90f1-cdb221c7a1b7" (UID: "a05e7694-028f-498e-90f1-cdb221c7a1b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:58:22.816813 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.816780    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7" (OuterVolumeSpecName: "kube-api-access-dnbm7") pod "a05e7694-028f-498e-90f1-cdb221c7a1b7" (UID: "a05e7694-028f-498e-90f1-cdb221c7a1b7"). InnerVolumeSpecName "kube-api-access-dnbm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:22.915413 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.915382    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnbm7\" (UniqueName: \"kubernetes.io/projected/a05e7694-028f-498e-90f1-cdb221c7a1b7-kube-api-access-dnbm7\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:22.915413 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.915408    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a05e7694-028f-498e-90f1-cdb221c7a1b7-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:22.915413 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:22.915419    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a05e7694-028f-498e-90f1-cdb221c7a1b7-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:23.181309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.181278    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:23.489013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.488923    2560 generic.go:356] "Generic (PLEG): container finished" podID="a05e7694-028f-498e-90f1-cdb221c7a1b7" containerID="1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985" exitCode=0
Jul 27 19:58:23.489013 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.488964    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"
Jul 27 19:58:23.489541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.489016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" event={"ID":"a05e7694-028f-498e-90f1-cdb221c7a1b7","Type":"ContainerDied","Data":"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"}
Jul 27 19:58:23.489541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.489077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv" event={"ID":"a05e7694-028f-498e-90f1-cdb221c7a1b7","Type":"ContainerDied","Data":"73423e815f68d82643db9b47c42e5aa8ab9681f2085990f337c6e047b2b0e46a"}
Jul 27 19:58:23.489541 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.489110    2560 scope.go:117] "RemoveContainer" containerID="1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"
Jul 27 19:58:23.497697 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.497681    2560 scope.go:117] "RemoveContainer" containerID="1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"
Jul 27 19:58:23.497947 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:58:23.497927    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985\": container with ID starting with 1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985 not found: ID does not exist" containerID="1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"
Jul 27 19:58:23.497996 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.497958    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985"} err="failed to get container status \"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985\": rpc error: code = NotFound desc = could not find container \"1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985\": container with ID starting with 1480805ed4c5683b554d5840d7fd0a19d1f78a3fee67fa554c068198bcfbf985 not found: ID does not exist"
Jul 27 19:58:23.510323 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.510302    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:58:23.514555 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.514536    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b4cd12-ffb96d85-hgngv"]
Jul 27 19:58:23.787357 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:23.787269    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" path="/var/lib/kubelet/pods/a05e7694-028f-498e-90f1-cdb221c7a1b7/volumes"
Jul 27 19:58:29.945881 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:29.945832    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:30.032414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:30.032380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:30.229320 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:30.229217    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:30.492605 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:30.492490    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:39.555018 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:39.554981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:41.279033 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.279000    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:58:41.279463 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.279241    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" podUID="80944007-62d1-4541-88af-ad155525b3dd" containerName="maas-api" containerID="cri-o://d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012" gracePeriod=30
Jul 27 19:58:41.326586 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.326551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:41.429061 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.429025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:41.530003 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.529939    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:58:41.530652 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.530618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:41.572350 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.572320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtfkt\" (UniqueName: \"kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt\") pod \"80944007-62d1-4541-88af-ad155525b3dd\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") "
Jul 27 19:58:41.572550 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.572371    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca\") pod \"80944007-62d1-4541-88af-ad155525b3dd\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") "
Jul 27 19:58:41.572550 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.572467    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") pod \"80944007-62d1-4541-88af-ad155525b3dd\" (UID: \"80944007-62d1-4541-88af-ad155525b3dd\") "
Jul 27 19:58:41.573078 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.573032    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80944007-62d1-4541-88af-ad155525b3dd" (UID: "80944007-62d1-4541-88af-ad155525b3dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:41.576197 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.575972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt" (OuterVolumeSpecName: "kube-api-access-mtfkt") pod "80944007-62d1-4541-88af-ad155525b3dd" (UID: "80944007-62d1-4541-88af-ad155525b3dd"). InnerVolumeSpecName "kube-api-access-mtfkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:41.576355 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.576201    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80944007-62d1-4541-88af-ad155525b3dd" (UID: "80944007-62d1-4541-88af-ad155525b3dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:58:41.579102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.579058    2560 generic.go:356] "Generic (PLEG): container finished" podID="80944007-62d1-4541-88af-ad155525b3dd" containerID="d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012" exitCode=0
Jul 27 19:58:41.579272 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.579143    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"
Jul 27 19:58:41.579272 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.579205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" event={"ID":"80944007-62d1-4541-88af-ad155525b3dd","Type":"ContainerDied","Data":"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"}
Jul 27 19:58:41.579421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.579290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q" event={"ID":"80944007-62d1-4541-88af-ad155525b3dd","Type":"ContainerDied","Data":"b66750829d02751423bdf6c4b55c9cd3773a6ac1575cfb6b769c1594d46d73e8"}
Jul 27 19:58:41.579421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.579326    2560 scope.go:117] "RemoveContainer" containerID="d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"
Jul 27 19:58:41.589570 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.589552    2560 scope.go:117] "RemoveContainer" containerID="d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"
Jul 27 19:58:41.590201 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:58:41.590173    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012\": container with ID starting with d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012 not found: ID does not exist" containerID="d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"
Jul 27 19:58:41.590414 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.590215    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012"} err="failed to get container status \"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012\": rpc error: code = NotFound desc = could not find container \"d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012\": container with ID starting with d15012b2a417d3b561044183e54d160808e45b5561c91eab891e25453f4eb012 not found: ID does not exist"
Jul 27 19:58:41.622481 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.622451    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:58:41.628883 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.628857    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-70aa40-64d9b46c65-d474q"]
Jul 27 19:58:41.673854 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.673821    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtfkt\" (UniqueName: \"kubernetes.io/projected/80944007-62d1-4541-88af-ad155525b3dd-kube-api-access-mtfkt\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.673854 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.673847    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80944007-62d1-4541-88af-ad155525b3dd-openshift-service-ca\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.673854 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.673859    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80944007-62d1-4541-88af-ad155525b3dd-maas-api-tls\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.684646 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.684618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:41.781945 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:41.781868    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80944007-62d1-4541-88af-ad155525b3dd" path="/var/lib/kubelet/pods/80944007-62d1-4541-88af-ad155525b3dd/volumes"
Jul 27 19:58:42.028977 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:42.028946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:48.398537 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:48.398499    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:48.508428 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:48.508394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:48.732041 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:48.731944    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:58:48.732210 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:48.732149    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy" containerID="cri-o://cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296" gracePeriod=30
Jul 27 19:58:48.761766 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:48.761730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:49.096462 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:49.096370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:58:49.455748 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:49.455707    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8696b8445c-j2rmp_b9ffeb85-c3dc-4944-bb29-c1ddddd7a823/authorino/0.log"
Jul 27 19:58:53.980333 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:53.980309    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:58:54.082539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082539 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082553    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082713    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082779 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082740    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082989 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082788    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082989 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082814    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:54.082989 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47lf6\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082989 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082904    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket\") pod \"80cddf89-12f4-47f3-9e54-effff04f33a3\" (UID: \"80cddf89-12f4-47f3-9e54-effff04f33a3\") "
Jul 27 19:58:54.082989 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.082906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:54.083283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.083166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:54.083283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.083192    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-credential-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.083283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.083209    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-certs\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.083283 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.083203    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:54.083669 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.083640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:54.084963 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.084931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:54.085074 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.084964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6" (OuterVolumeSpecName: "kube-api-access-47lf6") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "kube-api-access-47lf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:54.085421 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.085402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:58:54.085497 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.085482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80cddf89-12f4-47f3-9e54-effff04f33a3" (UID: "80cddf89-12f4-47f3-9e54-effff04f33a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:54.184293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184234    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-token\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184285    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-envoy\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184294    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-podinfo\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184293 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184304    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80cddf89-12f4-47f3-9e54-effff04f33a3-istiod-ca-cert\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184557 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184312    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-istio-data\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184557 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184320    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47lf6\" (UniqueName: \"kubernetes.io/projected/80cddf89-12f4-47f3-9e54-effff04f33a3-kube-api-access-47lf6\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.184557 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.184330    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80cddf89-12f4-47f3-9e54-effff04f33a3-workload-socket\") on node \"ip-10-0-140-57.ec2.internal\" DevicePath \"\""
Jul 27 19:58:54.638032 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.637993    2560 generic.go:356] "Generic (PLEG): container finished" podID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerID="cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296" exitCode=0
Jul 27 19:58:54.638200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.638046    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"
Jul 27 19:58:54.638200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.638079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerDied","Data":"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"}
Jul 27 19:58:54.638200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.638135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds" event={"ID":"80cddf89-12f4-47f3-9e54-effff04f33a3","Type":"ContainerDied","Data":"5ce96f547c527823feb2551e8e23064929cfcdfb65a0b6c0fb61571e28f8ee69"}
Jul 27 19:58:54.638200 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.638158    2560 scope.go:117] "RemoveContainer" containerID="cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"
Jul 27 19:58:54.653126 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.653100    2560 scope.go:117] "RemoveContainer" containerID="032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"
Jul 27 19:58:54.661407 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.661387    2560 scope.go:117] "RemoveContainer" containerID="cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"
Jul 27 19:58:54.661662 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:58:54.661643    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296\": container with ID starting with cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296 not found: ID does not exist" containerID="cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"
Jul 27 19:58:54.661739 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.661670    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296"} err="failed to get container status \"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296\": rpc error: code = NotFound desc = could not find container \"cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296\": container with ID starting with cdb4c73234d957ac458b8552da96a955b0d4b616d43da774d965afc802183296 not found: ID does not exist"
Jul 27 19:58:54.661739 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.661688    2560 scope.go:117] "RemoveContainer" containerID="032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"
Jul 27 19:58:54.661824 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.661803    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:58:54.661955 ip-10-0-140-57 kubenswrapper[2560]: E0727 19:58:54.661934    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc\": container with ID starting with 032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc not found: ID does not exist" containerID="032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"
Jul 27 19:58:54.662051 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.661960    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc"} err="failed to get container status \"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc\": rpc error: code = NotFound desc = could not find container \"032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc\": container with ID starting with 032d223f1f0a3e4f727fd3fc83fe3b6450c6ac1c1d1b0acf1ab9d9e29f6830fc not found: ID does not exist"
Jul 27 19:58:54.665623 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:54.665603    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-70aa40-openshift-default-5cfcd8794d-bmkds"]
Jul 27 19:58:55.228511 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:55.228478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ksnmw_712274e1-4ae2-4469-b7e4-acaba07feaf5/manager/0.log"
Jul 27 19:58:55.782333 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:55.782298    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" path="/var/lib/kubelet/pods/80cddf89-12f4-47f3-9e54-effff04f33a3/volumes"
Jul 27 19:58:55.935348 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:55.935318    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-69trh_e976d1bb-453a-480b-90f5-1dbd36655b0c/copy-manifests/0.log"
Jul 27 19:58:55.948553 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:55.948529    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-69trh_e976d1bb-453a-480b-90f5-1dbd36655b0c/manager/0.log"
Jul 27 19:58:56.616808 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:56.616759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ccbcc679c-57c62_d2672ee2-a919-4364-9bb6-9fd2fa0adf71/maas-api/0.log"
Jul 27 19:58:58.510596 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:58.510564    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8696b8445c-j2rmp_b9ffeb85-c3dc-4944-bb29-c1ddddd7a823/authorino/0.log"
Jul 27 19:58:58.876102 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:58.876075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h6vwh_5231f95e-7029-4b78-bd5f-fce5dcfb6d58/kuadrant-console-plugin/0.log"
Jul 27 19:58:59.396405 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:59.396368    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g6jc2_99130f6b-ee23-4c2a-8eb9-349f0d2f5d61/manager/1.log"
Jul 27 19:58:59.803936 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:58:59.803853    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87_e9c6860c-c6a7-4355-b1c0-e65054bf4bba/istio-proxy/0.log"
Jul 27 19:59:00.342728 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:00.342690    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/1.log"
Jul 27 19:59:00.435528 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:00.435491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:01.228430 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:01.228396    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qrk22_68041fe3-2173-4829-983b-7b13a15c7fbe/main/0.log"
Jul 27 19:59:01.347383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:01.347353    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7bd59_4f4decd2-4963-4997-9105-90b3968f1d13/main/0.log"
Jul 27 19:59:07.862258 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:07.862203    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:09.313159 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:09.313121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:10.883898 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:10.883825    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dn6m2_22142470-fec9-41b3-99cb-44dee37382c6/global-pull-secret-syncer/0.log"
Jul 27 19:59:10.985750 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:10.985717    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log"
Jul 27 19:59:11.109549 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:11.109522    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-57.ec2.internal_c8e632274fa8a2f60e358928d1be8d4d/haproxy/0.log"
Jul 27 19:59:15.358309 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:15.358274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8696b8445c-j2rmp_b9ffeb85-c3dc-4944-bb29-c1ddddd7a823/authorino/0.log"
Jul 27 19:59:15.460846 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:15.460809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h6vwh_5231f95e-7029-4b78-bd5f-fce5dcfb6d58/kuadrant-console-plugin/0.log"
Jul 27 19:59:15.826480 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:15.826440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g6jc2_99130f6b-ee23-4c2a-8eb9-349f0d2f5d61/manager/0.log"
Jul 27 19:59:15.850378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:15.850332    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g6jc2_99130f6b-ee23-4c2a-8eb9-349f0d2f5d61/manager/1.log"
Jul 27 19:59:18.188947 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:18.188919    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tltpb_1f6d77fe-c373-4716-b18b-33b87a355122/node-exporter/0.log"
Jul 27 19:59:18.215393 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:18.215364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tltpb_1f6d77fe-c373-4716-b18b-33b87a355122/kube-rbac-proxy/0.log"
Jul 27 19:59:18.240998 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:18.240975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tltpb_1f6d77fe-c373-4716-b18b-33b87a355122/init-textfile/0.log"
Jul 27 19:59:21.156884 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.156851    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"]
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157150    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133c6e78-0244-49c3-a8b6-a248c04a33b0" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157162    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="133c6e78-0244-49c3-a8b6-a248c04a33b0" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157172    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157177    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157183    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157189    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157196    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80944007-62d1-4541-88af-ad155525b3dd" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157203    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80944007-62d1-4541-88af-ad155525b3dd" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157212    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157217    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157227    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157232    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157260    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157272    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72482039-5c0d-4536-b843-b605088e40ff" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157277    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="72482039-5c0d-4536-b843-b605088e40ff" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157324    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157331    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d9525f6-ff0c-46e6-b458-55fe765525e1" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157337    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05e7694-028f-498e-90f1-cdb221c7a1b7" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157342    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80cddf89-12f4-47f3-9e54-effff04f33a3" containerName="istio-proxy"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157347    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="133c6e78-0244-49c3-a8b6-a248c04a33b0" containerName="maas-api"
Jul 27 19:59:21.157340 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157353    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="72482039-5c0d-4536-b843-b605088e40ff" containerName="maas-api"
Jul 27 19:59:21.158055 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.157359    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="80944007-62d1-4541-88af-ad155525b3dd" containerName="maas-api"
Jul 27 19:59:21.161301 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.161283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.165608 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.165584    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hwxjc\"/\"default-dockercfg-g7p4f\""
Jul 27 19:59:21.166383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.166341    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"kube-root-ca.crt\""
Jul 27 19:59:21.166505 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.166412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"openshift-service-ca.crt\""
Jul 27 19:59:21.179335 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.179299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"]
Jul 27 19:59:21.210170 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.210138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-podres\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.210378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.210181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6m4m\" (UniqueName: \"kubernetes.io/projected/a5198fae-5e9e-4128-91c2-c475851483dc-kube-api-access-l6m4m\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.210378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.210221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-sys\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.210378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.210269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-lib-modules\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.210378 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.210294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-proc\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-sys\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311533 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-lib-modules\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-proc\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-sys\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-podres\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-lib-modules\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311738 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6m4m\" (UniqueName: \"kubernetes.io/projected/a5198fae-5e9e-4128-91c2-c475851483dc-kube-api-access-l6m4m\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-proc\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.311896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.311766    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a5198fae-5e9e-4128-91c2-c475851483dc-podres\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.321998 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.321975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6m4m\" (UniqueName: \"kubernetes.io/projected/a5198fae-5e9e-4128-91c2-c475851483dc-kube-api-access-l6m4m\") pod \"perf-node-gather-daemonset-nkjjf\" (UID: \"a5198fae-5e9e-4128-91c2-c475851483dc\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.471187 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.471094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.615963 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.615937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"]
Jul 27 19:59:21.618353 ip-10-0-140-57 kubenswrapper[2560]: W0727 19:59:21.618317    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5198fae_5e9e_4128_91c2_c475851483dc.slice/crio-e88ebd0961d19e8b527edec576b533c31001a0e58f47be2507aa975ca39ce3e8 WatchSource:0}: Error finding container e88ebd0961d19e8b527edec576b533c31001a0e58f47be2507aa975ca39ce3e8: Status 404 returned error can't find the container with id e88ebd0961d19e8b527edec576b533c31001a0e58f47be2507aa975ca39ce3e8
Jul 27 19:59:21.758911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.758816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf" event={"ID":"a5198fae-5e9e-4128-91c2-c475851483dc","Type":"ContainerStarted","Data":"cae0d15f3b505224db2204a9f40a2c36ff689a59962cd8b7efb3a856a9165f41"}
Jul 27 19:59:21.758911 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.758868    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf" event={"ID":"a5198fae-5e9e-4128-91c2-c475851483dc","Type":"ContainerStarted","Data":"e88ebd0961d19e8b527edec576b533c31001a0e58f47be2507aa975ca39ce3e8"}
Jul 27 19:59:21.759141 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.759019    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:21.786024 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:21.785974    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf" podStartSLOduration=0.785958161 podStartE2EDuration="785.958161ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:21.783639082 +0000 UTC m=+3242.471503523" watchObservedRunningTime="2026-07-27 19:59:21.785958161 +0000 UTC m=+3242.473822603"
Jul 27 19:59:23.547732 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:23.547675    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrhh6_6659b515-acde-4fa4-8c70-35ec725e6b8e/dns/0.log"
Jul 27 19:59:23.575822 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:23.575789    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rrhh6_6659b515-acde-4fa4-8c70-35ec725e6b8e/kube-rbac-proxy/0.log"
Jul 27 19:59:23.717383 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:23.717356    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n4fr9_a7c2042c-583a-4024-8930-e53191447a71/dns-node-resolver/0.log"
Jul 27 19:59:24.285297 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:24.285267    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzcd5_0e6fb64f-8445-4e89-a2a3-c26659b8400d/node-ca/0.log"
Jul 27 19:59:25.335483 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:25.335453    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87_e9c6860c-c6a7-4355-b1c0-e65054bf4bba/istio-proxy/0.log"
Jul 27 19:59:25.502178 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:25.502146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cflrf_7ff28b5f-39bc-4a64-8120-d06805d36894/konnectivity-agent/0.log" limit=1024
Jul 27 19:59:25.573794 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:25.573759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/0.log"
Jul 27 19:59:25.599921 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:25.599835    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/1.log"
Jul 27 19:59:26.524826 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:26.524783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gbf2r_c209a0ea-bc78-4084-a079-197ad2da5d8f/serve-healthcheck-canary/0.log"
Jul 27 19:59:27.219169 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:27.219143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4n77p_93f8f292-fb8f-4e3d-8e85-f86b3fe70eae/kube-rbac-proxy/0.log"
Jul 27 19:59:27.247896 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:27.247877    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4n77p_93f8f292-fb8f-4e3d-8e85-f86b3fe70eae/exporter/0.log"
Jul 27 19:59:27.274556 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:27.274528    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4n77p_93f8f292-fb8f-4e3d-8e85-f86b3fe70eae/extractor/0.log"
Jul 27 19:59:27.773564 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:27.773534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-nkjjf"
Jul 27 19:59:29.764966 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:29.764935    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ksnmw_712274e1-4ae2-4469-b7e4-acaba07feaf5/manager/0.log"
Jul 27 19:59:30.342147 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:30.342116    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-69trh_e976d1bb-453a-480b-90f5-1dbd36655b0c/manager/0.log"
Jul 27 19:59:30.365227 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:30.365203    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-69trh_e976d1bb-453a-480b-90f5-1dbd36655b0c/copy-manifests/0.log"
Jul 27 19:59:31.547557 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:31.547441    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87_e9c6860c-c6a7-4355-b1c0-e65054bf4bba/istio-proxy/0.log"
Jul 27 19:59:31.749354 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:31.749318    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/0.log"
Jul 27 19:59:31.775331 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:31.775298    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/1.log"
Jul 27 19:59:31.873717 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:31.873693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6898ff9d7-btxrc_bc033c07-8330-40d9-9a3f-56e105329bcb/manager/0.log"
Jul 27 19:59:33.131357 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:33.131317    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-72h87_e9c6860c-c6a7-4355-b1c0-e65054bf4bba/istio-proxy/0.log"
Jul 27 19:59:33.329601 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:33.329567    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/0.log"
Jul 27 19:59:33.354400 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:33.354370    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-96grz_00878697-68fd-4c92-ad75-7fe7bdb43246/istio-proxy/1.log"
Jul 27 19:59:36.899688 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:36.899657    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5l5dm_122657b5-9762-45cd-bbdf-2269bb3a7f93/migrator/0.log"
Jul 27 19:59:36.929111 ip-10-0-140-57 kubenswrapper[2560]: I0727 19:59:36.929082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5l5dm_122657b5-9762-45cd-bbdf-2269bb3a7f93/graceful-termination/0.log"