Jul 08 04:16:20.834209 ip-10-0-143-106 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 04:16:20.834220 ip-10-0-143-106 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 04:16:20.834227 ip-10-0-143-106 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 04:16:20.834469 ip-10-0-143-106 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 04:16:30.984623 ip-10-0-143-106 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 04:16:30.984638 ip-10-0-143-106 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e6d84c91a9c4604b90e4cd68b53c49d --
Jul 08 04:18:28.954143 ip-10-0-143-106 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.353594    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360395    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360409    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360412    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360415    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360419    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360425    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.437277 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360429    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.433531 ip-10-0-143-106 systemd[1]: Started Kubernetes Kubelet.
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360434    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360437    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360441    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360444    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360446    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360449    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360452    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360454    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360463    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360466    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360470    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360473    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360475    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360478    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360481    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360484    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360487    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360489    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.438564 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360492    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360496    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360499    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360503    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360506    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360509    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360512    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360515    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360518    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360521    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360524    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360527    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360531    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360533    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360536    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360539    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360541    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360544    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360547    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.439517 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360550    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360552    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360555    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360558    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360561    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360563    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360566    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360568    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360571    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360573    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360576    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360578    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360581    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360583    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360586    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360589    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360591    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360594    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360596    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360599    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.440570 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360601    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360604    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360607    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360610    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360613    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360615    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360618    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360620    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360623    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360626    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360628    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360631    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360634    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360637    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360640    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360642    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360645    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360647    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360650    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360652    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.441480 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360655    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360657    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360660    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360662    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360665    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360667    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360670    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360672    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360675    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360677    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360680    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360682    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360685    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360688    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.360691    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362169    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362177    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362181    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362185    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.442588 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362188    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362191    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362195    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362198    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362201    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362204    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362206    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362209    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362212    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362216    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362220    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362223    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362226    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362229    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362232    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362235    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362237    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362240    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362243    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.443474 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362246    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362249    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362253    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362257    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362260    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362263    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362266    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362268    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362271    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362273    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362276    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362279    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362281    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362284    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362286    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362292    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362295    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362298    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362301    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.444383 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362304    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362307    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362309    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362311    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362314    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362316    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362319    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362321    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362324    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362326    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362329    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362332    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362334    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362337    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362339    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362342    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362344    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362347    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362349    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362352    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.445278 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362354    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362357    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362359    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362362    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362364    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362368    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362371    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362379    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362383    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362386    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362388    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362392    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362394    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362397    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362400    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362402    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362404    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362407    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362409    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.446169 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362412    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362414    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362417    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362419    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362422    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362424    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362427    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362429    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362432    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362434    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362437    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362439    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362442    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362444    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362447    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362449    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362452    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362454    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362875    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362881    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.447056 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362885    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362889    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362892    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362895    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362898    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362900    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362903    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362905    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362908    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362910    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362913    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362915    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362918    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362920    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362923    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362926    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362928    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362930    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362934    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362938    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.448202 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362941    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362943    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362946    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362948    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362951    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362953    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362956    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362958    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362961    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362963    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362966    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362968    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362974    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362979    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362982    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362986    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362989    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362992    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362994    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.449107 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362997    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.362999    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363002    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363004    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363007    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363010    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363014    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363016    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363019    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363021    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363024    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363026    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363029    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363031    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363034    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363036    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363039    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363041    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363044    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363046    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.450231 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363048    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363051    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363053    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363056    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363058    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363062    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363066    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363068    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363071    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363074    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363076    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363079    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363081    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363084    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363086    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363089    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363092    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363095    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363097    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363099    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.451139 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363102    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363104    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363107    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363109    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363112    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363114    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363117    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363119    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363122    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363124    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363126    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363130    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363133    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363136    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363139    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363141    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363144    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363148    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363220    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363226    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 04:18:29.452024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363232    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363236    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363241    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363245    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363249    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363253    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363256    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363259    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363262    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363266    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363269    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363272    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363275    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363278    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363281    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363283    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363289    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363291    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363294    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363298    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363301    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363305    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363307    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 04:18:29.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363311    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363314    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363317    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363320    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363323    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363326    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363330    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363337    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363340    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363343    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363346    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363349    2562 flags.go:64] FLAG: --enable-server="true"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363352    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363357    2562 flags.go:64] FLAG: --event-burst="100"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363361    2562 flags.go:64] FLAG: --event-qps="50"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363363    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363366    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363369    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363373    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363376    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363379    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363382    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363385    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363387    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363391    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 04:18:29.454075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363393    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363396    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363399    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363401    2562 flags.go:64] FLAG: --feature-gates=""
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363405    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363408    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363411    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363414    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363417    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363420    2562 flags.go:64] FLAG: --help="false"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363422    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363425    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363428    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363433    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363437    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363440    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363443    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363446    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363449    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363451    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363455    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363458    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363461    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363464    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 04:18:29.455226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363467    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363470    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363473    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363475    2562 flags.go:64] FLAG: --lock-file=""
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363478    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363481    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363484    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363489    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363492    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363495    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363497    2562 flags.go:64] FLAG: --logging-format="text"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363501    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363504    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363506    2562 flags.go:64] FLAG: --manifest-url=""
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363509    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363513    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363516    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363521    2562 flags.go:64] FLAG: --max-pods="110"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363523    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363527    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363529    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363534    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363538    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363541    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363544    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 04:18:29.456354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363551    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363554    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363557    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363560    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363563    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363568    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363571    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363574    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363577    2562 flags.go:64] FLAG: --port="10250"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363580    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363583    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f9b3746648e9eeee"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363586    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363589    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363591    2562 flags.go:64] FLAG: --register-node="true"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363594    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363598    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363600    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363603    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363606    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363610    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363613    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363616    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363619    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363621    2562 flags.go:64] FLAG: --runonce="false"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363624    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 04:18:29.459879 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363627    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363630    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363633    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363638    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363641    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363647    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363650    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363653    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363656    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363660    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363662    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363665    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363669    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363672    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363681    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363683    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363686    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363695    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363698    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363701    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363704    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363706    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363709    2562 flags.go:64] FLAG: --v="2"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363717    2562 flags.go:64] FLAG: --version="false"
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363721    2562 flags.go:64] FLAG: --vmodule=""
Jul 08 04:18:29.461226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363725    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.363728    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363867    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363873    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363877    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363880    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363883    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363886    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363889    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363892    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363896    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363899    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363903    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363905    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363908    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363911    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363914    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363916    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363919    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363922    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.564082 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363925    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363929    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363933    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363935    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363938    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363940    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363943    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363946    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363950    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363953    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363956    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363959    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363962    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363965    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363967    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363970    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363973    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363976    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363978    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.565206 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363981    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363983    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363986    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363990    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363992    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363997    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.363999    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364002    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364005    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364008    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364012    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364014    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364018    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364021    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364029    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364032    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364034    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364037    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364040    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364042    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.566193 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364045    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364047    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364050    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364052    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364055    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364058    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364060    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364063    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364065    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364068    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364071    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364073    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364076    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364078    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364081    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364084    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364087    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364090    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364093    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364095    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.567226 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364098    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364100    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364103    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364105    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364108    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364110    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364113    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364121    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364124    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364126    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364129    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364131    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364133    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364136    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364139    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364141    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364144    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364146    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364148    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364151    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.568303 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364154    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.364156    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.364796    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.371600    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.371615    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.371635    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.371641    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371729    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371734    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371737    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371741    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371744    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371746    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371749    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.569210 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371752    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371754    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371757    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371759    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371762    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371765    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371767    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371770    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371773    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371775    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371778    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371780    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371783    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371786    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371788    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371791    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371793    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371796    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371798    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371801    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.569891 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371809    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371812    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371815    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371818    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371821    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371823    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371826    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371828    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371831    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371833    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371836    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371838    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371841    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371844    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371847    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371849    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371851    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371854    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371870    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371873    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.570779 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371876    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371878    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371881    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371883    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371886    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371888    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371891    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371895    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371898    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371903    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371907    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371910    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371915    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371918    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371923    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371927    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371930    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371933    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371936    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.571668 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371939    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371941    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371945    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371947    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371950    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371952    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371955    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371958    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371960    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371963    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371965    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371968    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371971    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371973    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371975    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371978    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371981    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371983    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371986    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371989    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.572559 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371991    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371994    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371996    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.371999    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372002    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372007    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372009    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372012    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372015    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372018    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372020    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372023    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372025    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.372030    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372161    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 04:18:29.573808 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372167    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372169    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372172    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372175    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372178    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372181    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372184    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372187    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372189    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372192    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372194    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372199    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372202    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372205    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372208    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372210    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372214    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372217    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372220    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 04:18:29.574700 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372223    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372226    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372229    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372234    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372238    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372241    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372243    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372246    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372249    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372252    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372254    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372257    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372260    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372262    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372265    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372268    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372271    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372273    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372276    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372279    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 04:18:29.575648 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372281    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372284    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372286    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372289    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372291    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372294    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372297    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372299    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372302    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372304    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372307    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372309    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372312    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372314    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372316    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372320    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372324    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372326    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372329    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372332    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 04:18:29.576617 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372334    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372337    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372340    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372343    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372345    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372348    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372350    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372353    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372355    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372357    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372360    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372363    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372365    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372367    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372370    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372372    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372375    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372377    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372380    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372382    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 04:18:29.577597 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372385    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372387    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372392    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372395    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372397    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372400    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372404    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372408    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372410    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372413    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372415    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372418    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372420    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372423    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372426    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372428    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372432    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 04:18:29.578574 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:29.372436    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.372441    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.372555    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.376297    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.377976    2562 server.go:1019] "Starting client certificate rotation"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.378736    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.378779    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.381054    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.387619    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.396270    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.398362    2562 log.go:25] "Validated CRI v1 image API"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.399265    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 04:18:29.579572 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.405015    2562 fs.go:135] Filesystem UUIDs: map[722960b3-09d3-4a6e-896a-7bf5e4b556a2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8f8ab361-9112-4aaa-9c92-2895148e24a4:/dev/nvme0n1p3]
Jul 08 04:18:29.580285 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.405039    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 04:18:29.580285 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.408454    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.410152    2562 manager.go:216] Machine: {Timestamp:2026-07-08 04:18:29.408874629 +0000 UTC m=+0.329503104 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101988 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2708a5dc9f5026241397d2371a8465 SystemUUID:ec2708a5-dc9f-5026-2413-97d2371a8465 BootID:0e6d84c9-1a9c-4604-b90e-4cd68b53c49d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:4a:c4:48:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:4a:c4:48:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:7b:3c:ec:fe:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.410278    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.410363    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.413315    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.413341    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.413938    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.413948    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.413956    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.414460    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.415612    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418639    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418771    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418802    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418815    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418831    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418840    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.418850    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 04:18:29.580769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.419264    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.419286    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.422105    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.425633    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.425676    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.425937    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h8dnq"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426793    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426820    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426830    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426842    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426873    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426885    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426898    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426914    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426925    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426936    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426967    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.426979    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.428524    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.428550    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.429530    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.429527    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.432121    2562 server.go:1268] "Started kubelet"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.432187    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.432428    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.432490    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.434044    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.434249    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.440453    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.440458    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.440519    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.441023    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.441040    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.441017    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.441146    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.441151    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.472215    2562 factory.go:55] Registering systemd factory
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.473507    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.473934    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474171    2562 factory.go:153] Registering CRI-O factory
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474188    2562 factory.go:223] Registration of the crio container factory successfully
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474248    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474286    2562 factory.go:103] Registering Raw factory
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474303    2562 manager.go:1196] Started watching for new ooms in manager
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.474982    2562 manager.go:349] Starting recovery of all containers
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.479015    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 04:18:29.583817 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.479309    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.479151    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587b62eb353  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.432087379 +0000 UTC m=+0.352715846,LastTimestamp:2026-07-08 04:18:29.432087379 +0000 UTC m=+0.352715846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.489023    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.489100    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.493308    2562 manager.go:354] Recovery completed
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.509601    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.518466    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.518493    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.518502    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519069    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519081    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519101    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519113    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519869    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519898    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.519910    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.520617    2562 policy_none.go:49] "None policy: Start"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.520635    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.520652    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.521516    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.521697    2562 policy_none.go:47] "Start"
Jul 08 04:18:29.586209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.529664    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.539360    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.540552    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.554649    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.519883477 +0000 UTC m=+0.440511941,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558454    2562 manager.go:337] "Starting Device Plugin manager"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.558489    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558501    2562 server.go:87] "Starting device plugin registration server"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558778    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558790    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558888    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.558993    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.559004    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.559531    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.559745    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:29.587862 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.564420    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.519904926 +0000 UTC m=+0.440533390,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.613212    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.519914484 +0000 UTC m=+0.440542948,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.622387    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587c0f33f78  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.612740472 +0000 UTC m=+0.533368938,LastTimestamp:2026-07-08 04:18:29.612740472 +0000 UTC m=+0.533368938,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.659822    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.661691    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.661725    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.661736    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.661762    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.671029    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.661706457 +0000 UTC m=+0.582334926,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.680220    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.689047 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.680159    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.661729861 +0000 UTC m=+0.582358331,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.706608 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.691557    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.661739854 +0000 UTC m=+0.582368320,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.706608 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.691753    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.721906    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.721964    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.721995    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.722034    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.736521    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.822529    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"]
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.822645    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.824403    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.824438    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.824450    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.825841    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.825960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.825989    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826621    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826652    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826662    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826624    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826727    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.826742    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.827951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.827976    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.828658    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.828689    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.828700    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.832405    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.824417646 +0000 UTC m=+0.745046113,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.873993 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.846366    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.824443748 +0000 UTC m=+0.745072215,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.876279 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.860069    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.824454353 +0000 UTC m=+0.745082821,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.876279 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.869083    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.876279 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.871772    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.826640293 +0000 UTC m=+0.747268764,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:29.876279 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.875791    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:29.881361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.880966    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.881852    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.881882    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.881901    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.881951    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.881987    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.826657349 +0000 UTC m=+0.747285816,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.899798    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.899881    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.826666392 +0000 UTC m=+0.747294859,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.917207    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.826713745 +0000 UTC m=+0.747342217,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.934329    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.826734603 +0000 UTC m=+0.747363071,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.942387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/431d5d4114230efc4038e4bf6b8e68b0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-106.ec2.internal\" (UID: \"431d5d4114230efc4038e4bf6b8e68b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.016524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.942438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:29.942459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.944330    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.826747715 +0000 UTC m=+0.747376183,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.954264    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.828670768 +0000 UTC m=+0.749299236,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.963328    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.828694809 +0000 UTC m=+0.749323276,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.973118    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb5557ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb5557ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518505983 +0000 UTC m=+0.439134446,LastTimestamp:2026-07-08 04:18:29.828704101 +0000 UTC m=+0.749332567,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.017454 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.983766    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb54efea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb54efea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518479338 +0000 UTC m=+0.439107802,LastTimestamp:2026-07-08 04:18:29.881867298 +0000 UTC m=+0.802495768,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.017720 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:29.992120    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-106.ec2.internal.18c03587bb55367c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-106.ec2.internal.18c03587bb55367c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-106.ec2.internal,UID:ip-10-0-143-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:29.518497404 +0000 UTC m=+0.439125871,LastTimestamp:2026-07-08 04:18:29.881889773 +0000 UTC m=+0.802518245,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.042787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/431d5d4114230efc4038e4bf6b8e68b0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-106.ec2.internal\" (UID: \"431d5d4114230efc4038e4bf6b8e68b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.042835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.042854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.042916    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.042919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/431d5d4114230efc4038e4bf6b8e68b0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-106.ec2.internal\" (UID: \"431d5d4114230efc4038e4bf6b8e68b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.043004    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefaa663ec39fc89d19e48763868a1f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal\" (UID: \"eefaa663ec39fc89d19e48763868a1f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.156847 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.106761    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms"
Jul 08 04:18:30.172788 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.172436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.179720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.303399    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.304798    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.304828    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.304838    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:30.315518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.304866    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.480209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.327984    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:30.480209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.370459    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 04:18:30.480209 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.388569    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.499367    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.567173    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.568205    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.568238    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.568252    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:30.657286 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.576281    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 08 04:18:30.811971 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.766508    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:30.816750    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431d5d4114230efc4038e4bf6b8e68b0.slice/crio-e5e4a40659dd2df94f255130a4158c99361c732a4711a903ac2a60e488369983 WatchSource:0}: Error finding container e5e4a40659dd2df94f255130a4158c99361c732a4711a903ac2a60e488369983: Status 404 returned error can't find the container with id e5e4a40659dd2df94f255130a4158c99361c732a4711a903ac2a60e488369983
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:30.817184    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefaa663ec39fc89d19e48763868a1f4.slice/crio-4c8de02a1fe25c4f9dd1fb04de9a4d38565ee955826704ff45c45d0a98e2b0f3 WatchSource:0}: Error finding container 4c8de02a1fe25c4f9dd1fb04de9a4d38565ee955826704ff45c45d0a98e2b0f3: Status 404 returned error can't find the container with id 4c8de02a1fe25c4f9dd1fb04de9a4d38565ee955826704ff45c45d0a98e2b0f3
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:30.824395    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.833402    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588092eeeac  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52d26498fbce9f8ab56799e6e6f1920bc238d2d31f38945eab91ebc5f68b43dc\",Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:30.8246115 +0000 UTC m=+1.745239970,LastTimestamp:2026-07-08 04:18:30.8246115 +0000 UTC m=+1.745239970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.843687    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-143-106.ec2.internal.18c03588092fe7e6  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-143-106.ec2.internal,UID:431d5d4114230efc4038e4bf6b8e68b0,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1\",Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:30.824675302 +0000 UTC m=+1.745303755,LastTimestamp:2026-07-08 04:18:30.824675302 +0000 UTC m=+1.745303755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:30.993573 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:30.917415    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.134563    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.135885    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.135951    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.135963    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.135992    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:31.183090 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:31.155629    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:31.499423 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.499389    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:31.733253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.733184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal" event={"ID":"431d5d4114230efc4038e4bf6b8e68b0","Type":"ContainerStarted","Data":"e5e4a40659dd2df94f255130a4158c99361c732a4711a903ac2a60e488369983"}
Jul 08 04:18:31.734590 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:31.734561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerStarted","Data":"4c8de02a1fe25c4f9dd1fb04de9a4d38565ee955826704ff45c45d0a98e2b0f3"}
Jul 08 04:18:32.262683 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.262641    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 08 04:18:32.499951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.499909    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:32.526927 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.526828    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 04:18:32.527072 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.526974    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s"
Jul 08 04:18:32.643317 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.643278    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 04:18:32.756433 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.756383    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:32.757645 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.757617    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:32.757784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.757665    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:32.757784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.757680    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:32.757784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.757711    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:32.775610 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.775569    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:32.828319 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.828206    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-143-106.ec2.internal.18c035888012ef46  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-143-106.ec2.internal,UID:431d5d4114230efc4038e4bf6b8e68b0,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1\" in 1.994s (1.994s including waiting). Image size: 342879910 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:32.81926535 +0000 UTC m=+3.739893821,LastTimestamp:2026-07-08 04:18:32.81926535 +0000 UTC m=+3.739893821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:32.838413 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.838273    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035888018e5e2  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52d26498fbce9f8ab56799e6e6f1920bc238d2d31f38945eab91ebc5f68b43dc\" in 1.995s (1.995s including waiting). Image size: 303912755 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:32.819656162 +0000 UTC m=+3.740284614,LastTimestamp:2026-07-08 04:18:32.819656162 +0000 UTC m=+3.740284614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:32.898887 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.898787    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-143-106.ec2.internal.18c035888430a582  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-143-106.ec2.internal,UID:431d5d4114230efc4038e4bf6b8e68b0,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:32.88832141 +0000 UTC m=+3.808949877,LastTimestamp:2026-07-08 04:18:32.88832141 +0000 UTC m=+3.808949877,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:32.908592 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:32.908511    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-143-106.ec2.internal.18c0358884a8683b  kube-system    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-143-106.ec2.internal,UID:431d5d4114230efc4038e4bf6b8e68b0,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:32.896170043 +0000 UTC m=+3.816798511,LastTimestamp:2026-07-08 04:18:32.896170043 +0000 UTC m=+3.816798511,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:32.944008 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.943983    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:32.945865 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.945835    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:32.945993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.945906    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:32.945993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:32.945927    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:33.063495 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.063410    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035888e13ded6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.054207702 +0000 UTC m=+3.974836172,LastTimestamp:2026-07-08 04:18:33.054207702 +0000 UTC m=+3.974836172,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:33.073984 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.073877    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035888e99cafe  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.062984446 +0000 UTC m=+3.983612918,LastTimestamp:2026-07-08 04:18:33.062984446 +0000 UTC m=+3.983612918,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:33.110752 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.110723    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 04:18:33.499491 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.499415    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:33.739674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.739641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal" event={"ID":"431d5d4114230efc4038e4bf6b8e68b0","Type":"ContainerStarted","Data":"84b1f7c4fe068689f41d6240cf223eef616d3d113cb81daed92e8f9ee8af0552"}
Jul 08 04:18:33.739674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.739675    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:33.740499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.740483    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:33.740551 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.740516    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:33.740551 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.740529    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:33.740717 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.740704    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:33.741367 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.741335    2562 generic.go:356] "Generic (PLEG): container finished" podID="eefaa663ec39fc89d19e48763868a1f4" containerID="b35027bed9e88acc19c97cfcfc41d1fcbc498481819702009374373c06c688f4" exitCode=0
Jul 08 04:18:33.741421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.741377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerDied","Data":"b35027bed9e88acc19c97cfcfc41d1fcbc498481819702009374373c06c688f4"}
Jul 08 04:18:33.741421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.741388    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:33.742144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.742130    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:33.742207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.742157    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:33.742207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:33.742168    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:33.742357 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.742345    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:33.754283 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.754051    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588b736ea8b  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52d26498fbce9f8ab56799e6e6f1920bc238d2d31f38945eab91ebc5f68b43dc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.744370315 +0000 UTC m=+4.664998782,LastTimestamp:2026-07-08 04:18:33.744370315 +0000 UTC m=+4.664998782,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:33.832721 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.832640    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bbf27298  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.82376924 +0000 UTC m=+4.744397710,LastTimestamp:2026-07-08 04:18:33.82376924 +0000 UTC m=+4.744397710,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:33.843172 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:33.843080    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bc69521d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.831559709 +0000 UTC m=+4.752188177,LastTimestamp:2026-07-08 04:18:33.831559709 +0000 UTC m=+4.752188177,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:34.501631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.501602    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:34.744942 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.744913    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/0.log"
Jul 08 04:18:34.745385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.745301    2562 generic.go:356] "Generic (PLEG): container finished" podID="eefaa663ec39fc89d19e48763868a1f4" containerID="f9b983b0cf0a5676d972db8297cd6d1442220db25bc4b2f7a90826006ea4292c" exitCode=1
Jul 08 04:18:34.745385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.745337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerDied","Data":"f9b983b0cf0a5676d972db8297cd6d1442220db25bc4b2f7a90826006ea4292c"}
Jul 08 04:18:34.745385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.745369    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:34.745557 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.745399    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:34.746309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746291    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:34.746400 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746320    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:34.746400 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746331    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:34.746534 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:34.746520    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:34.746956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746927    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:34.746996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746967    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:34.746996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.746979    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:34.747133 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:34.747121    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:34.747174 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:34.747164    2562 scope.go:117] "RemoveContainer" containerID="f9b983b0cf0a5676d972db8297cd6d1442220db25bc4b2f7a90826006ea4292c"
Jul 08 04:18:34.760086 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:34.760001    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588b736ea8b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588b736ea8b  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52d26498fbce9f8ab56799e6e6f1920bc238d2d31f38945eab91ebc5f68b43dc\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.744370315 +0000 UTC m=+4.664998782,LastTimestamp:2026-07-08 04:18:34.750278086 +0000 UTC m=+5.670906540,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:34.879255 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:34.879174    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bbf27298\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bbf27298  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.82376924 +0000 UTC m=+4.744397710,LastTimestamp:2026-07-08 04:18:34.867640316 +0000 UTC m=+5.788268782,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:34.889235 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:34.889136    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bc69521d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c03588bc69521d  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:33.831559709 +0000 UTC m=+4.752188177,LastTimestamp:2026-07-08 04:18:34.87550193 +0000 UTC m=+5.796130400,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:35.499186 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.499159    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:35.738971 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:35.738939    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s"
Jul 08 04:18:35.747917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.747893    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/1.log"
Jul 08 04:18:35.748326 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.748311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/0.log"
Jul 08 04:18:35.748634 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.748609    2562 generic.go:356] "Generic (PLEG): container finished" podID="eefaa663ec39fc89d19e48763868a1f4" containerID="dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27" exitCode=1
Jul 08 04:18:35.748678 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.748649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerDied","Data":"dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27"}
Jul 08 04:18:35.748710 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.748688    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:35.748743 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.748719    2562 scope.go:117] "RemoveContainer" containerID="f9b983b0cf0a5676d972db8297cd6d1442220db25bc4b2f7a90826006ea4292c"
Jul 08 04:18:35.749647 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.749593    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:35.749647 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.749631    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:35.749756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.749650    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:35.749969 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:35.749952    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:35.750030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.750018    2562 scope.go:117] "RemoveContainer" containerID="dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27"
Jul 08 04:18:35.750206 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:35.750185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podUID="eefaa663ec39fc89d19e48763868a1f4"
Jul 08 04:18:35.760504 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:35.760427    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035892ec484f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4),Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:35.750139126 +0000 UTC m=+6.670767600,LastTimestamp:2026-07-08 04:18:35.750139126 +0000 UTC m=+6.670767600,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:35.975913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.975874    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:35.979906 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.979885    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:35.980039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.979927    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:35.980039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.979944    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:35.980039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:35.979980    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:35.999575 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:35.999544    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:36.502268 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.502236    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:36.751587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.751560    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/1.log"
Jul 08 04:18:36.752051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.752035    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:36.752980 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.752918    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:36.752980 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.752948    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:36.752980 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.752959    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:36.753198 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:36.753185    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:36.753245 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:36.753235    2562 scope.go:117] "RemoveContainer" containerID="dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27"
Jul 08 04:18:36.753359 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:36.753342    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podUID="eefaa663ec39fc89d19e48763868a1f4"
Jul 08 04:18:36.762572 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:36.762491    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035892ec484f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal.18c035892ec484f6  openshift-machine-config-operator    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal,UID:eefaa663ec39fc89d19e48763868a1f4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4),Source:EventSource{Component:kubelet,Host:ip-10-0-143-106.ec2.internal,},FirstTimestamp:2026-07-08 04:18:35.750139126 +0000 UTC m=+6.670767600,LastTimestamp:2026-07-08 04:18:36.753314762 +0000 UTC m=+7.673943231,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-106.ec2.internal,}"
Jul 08 04:18:37.098984 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:37.098918    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:37.099998 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:37.099979    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:37.100072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:37.100017    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:37.100072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:37.100031    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:37.475446 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:37.475361    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 04:18:37.498664 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:37.498632    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:37.775396 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:37.775313    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 04:18:38.366397 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:38.366363    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 08 04:18:38.499541 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:38.499510    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:39.370278 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:39.370240    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 04:18:39.498973 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:39.498942    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:39.559903 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:39.559848    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:40.498280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:40.498251    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:41.497116 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:41.497081    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:42.148510 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:42.148480    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s"
Jul 08 04:18:42.400435 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.400337    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:42.401333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.401315    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:42.401427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.401351    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:42.401427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.401364    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:42.401427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.401399    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:42.418492 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:42.418463    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:42.497393 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:42.497364    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 04:18:43.100386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.100358    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h8dnq"
Jul 08 04:18:43.377377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.377283    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 04:18:43.511693 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.511666    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.527463 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.527444    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.583758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.583737    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.844961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.844879    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.844961 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:43.844904    2562 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.881712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.881680    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.897528 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.897511    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:43.955855 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:43.955835    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.104882 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.104777    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 04:13:43 +0000 UTC" deadline="2027-12-26 08:57:58.045257042 +0000 UTC"
Jul 08 04:18:44.104882 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.104829    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12868h39m13.940447279s"
Jul 08 04:18:44.213869 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.213829    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.213869 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:44.213853    2562 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.466956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.466878    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.484832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.484807    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.541447 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.541424    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.816523 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.816446    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.816523 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:44.816470    2562 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:44.838738 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:44.838710    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 04:18:45.975454 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:45.975415    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:45.976515 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:45.976487    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:45.976635 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:45.976528    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:45.976635 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:45.976541    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:46.011191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:46.011166    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 04:18:46.922169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:46.922141    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:46.937946 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:46.937931    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:46.996464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:46.996442    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:47.276816 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:47.276742    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:47.276816 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:47.276788    2562 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-143-106.ec2.internal" not found
Jul 08 04:18:48.744418 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:48.744389    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 04:18:49.154735 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.154649    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:49.419102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.419042    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:49.420274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.420256    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:49.420357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.420288    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:49.420357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.420299    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:49.420357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.420326    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:49.428990 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:49.428974    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:49.429034 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.428998    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-106.ec2.internal\": node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.448788 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.448765    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.549894 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.549868    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.560012 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.559974    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.650682 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.650636    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.751305 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.751235    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.851590 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.851541    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:49.952271 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:49.952236    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.052723 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.052654    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.153231 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.153189    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.253705 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.253679    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.354290 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.354239    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.455242 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.455204    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.555742 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.555702    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.656397 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.656337    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.756966 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.756940    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.857498 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.857451    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:50.958359 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:50.958296    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.058813 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.058778    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.159393 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.159359    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.259955 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.259899    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.360499 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.360462    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.461592 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.461561    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.562095 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.562033    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.662653 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.662631    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.722986 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.722965    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 04:18:51.724415 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.724402    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 04:18:51.724483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.724430    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 04:18:51.724483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.724440    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeHasSufficientPID"
Jul 08 04:18:51.724670 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.724659    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-106.ec2.internal\" not found" node="ip-10-0-143-106.ec2.internal"
Jul 08 04:18:51.724715 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.724705    2562 scope.go:117] "RemoveContainer" containerID="dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27"
Jul 08 04:18:51.762925 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.762889    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.863137 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:51.863116    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-106.ec2.internal\" not found"
Jul 08 04:18:51.940321 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.940296    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 04:18:51.941230 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.941217    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:51.951261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.951242    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 04:18:51.951363 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.951351    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"
Jul 08 04:18:51.961375 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:51.959842    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 04:18:52.433286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.433237    2562 apiserver.go:52] "Watching apiserver"
Jul 08 04:18:52.440014 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.439994    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 04:18:52.441080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.441057    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zhn9k","openshift-network-diagnostics/network-check-target-z7jlc","openshift-network-operator/iptables-alerter-j6wv4","openshift-ovn-kubernetes/ovnkube-node-kvbrv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf","openshift-cluster-node-tuning-operator/tuned-szrm5","openshift-dns/node-resolver-zlxf4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal","openshift-multus/multus-additional-cni-plugins-bsd5k","openshift-multus/multus-trncw","openshift-multus/network-metrics-daemon-6sw9w","kube-system/global-pull-secret-syncer-x2dzz","kube-system/konnectivity-agent-4t99r","kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal"]
Jul 08 04:18:52.442564 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.442549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.443684 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.443668    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.444909 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.444888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.445028 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.444947    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.445028 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.444961    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.445028 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.445003    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pc7zj\""
Jul 08 04:18:52.445907 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.445889    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 04:18:52.445992 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.445948    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 04:18:52.446091 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.446032    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kgj56\""
Jul 08 04:18:52.446236 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.446222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.447318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.447296    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.447385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.447317    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.447477 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.447449    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 04:18:52.447614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.447500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.447614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.447553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fgc29\""
Jul 08 04:18:52.448300 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448283    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 04:18:52.448423 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.448488 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.448544 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s2r6g\""
Jul 08 04:18:52.448670 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.448768 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 04:18:52.448844 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448827    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 04:18:52.448923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.448884    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 04:18:52.450022 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.450005    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.450453 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.450434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 04:18:52.450526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.450442    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.450526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.450485    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.450725 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.450711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cmrjf\""
Jul 08 04:18:52.451291 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.451272    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.451405 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.451301    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-twj9h\""
Jul 08 04:18:52.451405 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.451335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.451405 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.451391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.452171 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452151    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 04:18:52.452272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 04:18:52.452272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452161    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.452769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:52.453147 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.452878    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:18:52.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452955    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.453147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.452964    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 04:18:52.453433 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453324    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wm6b8\""
Jul 08 04:18:52.453433 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453385    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 04:18:52.453646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453625    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 04:18:52.453646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453635    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 04:18:52.453646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453643    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k254b\""
Jul 08 04:18:52.453926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.453915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.455175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8696742d-36e5-4f6e-b22d-f944a329796b-hosts-file\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.455247 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8696742d-36e5-4f6e-b22d-f944a329796b-tmp-dir\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.455247 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zntrg\" (UniqueName: \"kubernetes.io/projected/8696742d-36e5-4f6e-b22d-f944a329796b-kube-api-access-zntrg\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.455407 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.455504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455432    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 04:18:52.455504 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.455453    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:18:52.455787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455767    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 04:18:52.455955 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.455943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rfhd\""
Jul 08 04:18:52.457369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.457353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.457439 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.457405    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:18:52.465612 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.465593    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 04:18:52.485015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.484994    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n2z7s"
Jul 08 04:18:52.489540 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.489496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-106.ec2.internal" podStartSLOduration=1.489484055 podStartE2EDuration="1.489484055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:18:52.489437006 +0000 UTC m=+23.410065480" watchObservedRunningTime="2026-07-08 04:18:52.489484055 +0000 UTC m=+23.410112519"
Jul 08 04:18:52.492261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.492219    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n2z7s"
Jul 08 04:18:52.542377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.542352    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 04:18:52.555976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.555956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-var-lib-kubelet\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.556070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.555983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/558744a4-2048-41cb-a017-a9a02e133112-serviceca\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.556070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-bin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.556070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-kubelet\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-var-lib-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8696742d-36e5-4f6e-b22d-f944a329796b-tmp-dir\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.556234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-sys\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.556234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5sp\" (UniqueName: \"kubernetes.io/projected/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-kube-api-access-4j5sp\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.556234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-bin\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-system-cni-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-registration-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-node-log\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-modprobe-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556366    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8696742d-36e5-4f6e-b22d-f944a329796b-tmp-dir\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxfjb\" (UniqueName: \"kubernetes.io/projected/558744a4-2048-41cb-a017-a9a02e133112-kube-api-access-fxfjb\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf75l\" (UniqueName: \"kubernetes.io/projected/323ceb42-e486-41f7-b456-ec33939b321f-kube-api-access-hf75l\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.556443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-kubelet-config\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-ovn\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-os-release\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-socket-dir-parent\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-config\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-script-lib\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-sys-fs\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-slash\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-netns\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-konnectivity-ca\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-systemd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.556787 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-log-socket\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-env-overrides\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8696742d-36e5-4f6e-b22d-f944a329796b-hosts-file\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-kubernetes\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-system-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-kubelet\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8696742d-36e5-4f6e-b22d-f944a329796b-hosts-file\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-daemon-config\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-etc-kubernetes\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-netd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.556986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysconfig\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-conf\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-cnibin\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-socket-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-agent-certs\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26eb2796-9605-4cc2-8572-0516533f8bfb-ovn-node-metrics-cert\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-lib-modules\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.557403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-conf-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-systemd-units\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fd9k\" (UniqueName: \"kubernetes.io/projected/26eb2796-9605-4cc2-8572-0516533f8bfb-kube-api-access-2fd9k\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-host\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlqff\" (UniqueName: \"kubernetes.io/projected/4939047a-a472-4db4-bef0-7d3a0a114182-kube-api-access-rlqff\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cq5q\" (UniqueName: \"kubernetes.io/projected/20f82749-da03-4eb3-81f6-69743f8f46f7-kube-api-access-5cq5q\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-k8s-cni-cncf-io\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-netns\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-hostroot\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zntrg\" (UniqueName: \"kubernetes.io/projected/8696742d-36e5-4f6e-b22d-f944a329796b-kube-api-access-zntrg\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-systemd\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbg7p\" (UniqueName: \"kubernetes.io/projected/caf8d342-8fe1-461f-96d1-9d4c08c316d2-kube-api-access-bbg7p\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-os-release\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cnibin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-multus\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-multus-certs\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ec34282-86a0-4ff0-874d-472781358e5d-host-slash\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-run\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-tuned\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-tmp\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-device-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cni-binary-copy\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ec34282-86a0-4ff0-874d-472781358e5d-iptables-alerter-script\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxql\" (UniqueName: \"kubernetes.io/projected/8ec34282-86a0-4ff0-874d-472781358e5d-kube-api-access-nsxql\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558744a4-2048-41cb-a017-a9a02e133112-host\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-dbus\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.558483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.557963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-etc-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.563094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.563077    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 04:18:52.566815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.566801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zntrg\" (UniqueName: \"kubernetes.io/projected/8696742d-36e5-4f6e-b22d-f944a329796b-kube-api-access-zntrg\") pod \"node-resolver-zlxf4\" (UID: \"8696742d-36e5-4f6e-b22d-f944a329796b\") " pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.658352 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbg7p\" (UniqueName: \"kubernetes.io/projected/caf8d342-8fe1-461f-96d1-9d4c08c316d2-kube-api-access-bbg7p\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.658352 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-os-release\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cnibin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-multus\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-multus-certs\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-multus\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-os-release\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cnibin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ec34282-86a0-4ff0-874d-472781358e5d-host-slash\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-run\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-tuned\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.658578 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658508    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ec34282-86a0-4ff0-874d-472781358e5d-host-slash\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658497    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-multus-certs\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-tmp\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-device-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cni-binary-copy\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-run\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.658771    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ec34282-86a0-4ff0-874d-472781358e5d-iptables-alerter-script\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxql\" (UniqueName: \"kubernetes.io/projected/8ec34282-86a0-4ff0-874d-472781358e5d-kube-api-access-nsxql\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-device-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.658854    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:53.15881274 +0000 UTC m=+24.079441199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558744a4-2048-41cb-a017-a9a02e133112-host\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-dbus\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.658982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.659118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-etc-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-var-lib-kubelet\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/558744a4-2048-41cb-a017-a9a02e133112-serviceca\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-bin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558744a4-2048-41cb-a017-a9a02e133112-host\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-var-lib-kubelet\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-cni-binary-copy\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-dbus\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-kubelet\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-var-lib-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-sys\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5sp\" (UniqueName: \"kubernetes.io/projected/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-kube-api-access-4j5sp\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-bin\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-system-cni-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-registration-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.659933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-node-log\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ec34282-86a0-4ff0-874d-472781358e5d-iptables-alerter-script\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-modprobe-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxfjb\" (UniqueName: \"kubernetes.io/projected/558744a4-2048-41cb-a017-a9a02e133112-kube-api-access-fxfjb\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659926    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-sys\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf75l\" (UniqueName: \"kubernetes.io/projected/323ceb42-e486-41f7-b456-ec33939b321f-kube-api-access-hf75l\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-etc-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-kubelet-config\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.659992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-ovn\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660081    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f3d653f-60c9-4f73-85d3-d4124b1861ea-kubelet-config\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-node-log\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-modprobe-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-registration-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660515    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/558744a4-2048-41cb-a017-a9a02e133112-serviceca\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660579    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-cni-bin\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-kubelet\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.660791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660673    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-var-lib-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-openvswitch\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-os-release\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-socket-dir-parent\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-config\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-script-lib\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660911    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-binary-copy\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-system-cni-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.660995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-ovn\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661004    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-bin\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4939047a-a472-4db4-bef0-7d3a0a114182-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661062    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-tuned\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661086    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-os-release\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.661575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-socket-dir-parent\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-d\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-sys-fs\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.661251    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-slash\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.661306    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:18:53.16128771 +0000 UTC m=+24.081916173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661318    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661319    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-slash\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-netns\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-sys-fs\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661397    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-run-netns\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-konnectivity-ca\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-systemd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-log-socket\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.662383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-env-overrides\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-kubernetes\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf8d342-8fe1-461f-96d1-9d4c08c316d2-tmp\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-run-systemd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-system-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-kubelet\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-daemon-config\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-kubernetes\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-etc-kubernetes\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-netd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661699    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-etc-kubernetes\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysconfig\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-var-lib-kubelet\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661699    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-system-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661588    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-log-socket\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-conf\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-cnibin\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.663051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-host-cni-netd\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-socket-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysconfig\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-agent-certs\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4939047a-a472-4db4-bef0-7d3a0a114182-cnibin\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.661985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26eb2796-9605-4cc2-8572-0516533f8bfb-ovn-node-metrics-cert\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-sysctl-conf\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-socket-dir\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-lib-modules\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-script-lib\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-conf-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-lib-modules\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-systemd-units\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26eb2796-9605-4cc2-8572-0516533f8bfb-systemd-units\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662211    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-ovnkube-config\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fd9k\" (UniqueName: \"kubernetes.io/projected/26eb2796-9605-4cc2-8572-0516533f8bfb-kube-api-access-2fd9k\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.663543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-host\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlqff\" (UniqueName: \"kubernetes.io/projected/4939047a-a472-4db4-bef0-7d3a0a114182-kube-api-access-rlqff\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-conf-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cq5q\" (UniqueName: \"kubernetes.io/projected/20f82749-da03-4eb3-81f6-69743f8f46f7-kube-api-access-5cq5q\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-host\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20f82749-da03-4eb3-81f6-69743f8f46f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-k8s-cni-cncf-io\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-netns\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662741    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-cni-dir\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-k8s-cni-cncf-io\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-host-run-netns\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662785    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-hostroot\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-hostroot\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-multus-daemon-config\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-systemd\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caf8d342-8fe1-461f-96d1-9d4c08c316d2-etc-systemd\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.662912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-konnectivity-ca\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.664010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.663019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26eb2796-9605-4cc2-8572-0516533f8bfb-env-overrides\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.664659 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.664639    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8fa9f0-c0fd-4b15-8d71-25b5fb091424-agent-certs\") pod \"konnectivity-agent-4t99r\" (UID: \"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424\") " pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.664707 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.664691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26eb2796-9605-4cc2-8572-0516533f8bfb-ovn-node-metrics-cert\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.668088 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.668067    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:18:52.668206 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.668092    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:18:52.668206 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.668106    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:52.668206 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.668168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:53.168150609 +0000 UTC m=+24.088779063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:52.669504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.669478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbg7p\" (UniqueName: \"kubernetes.io/projected/caf8d342-8fe1-461f-96d1-9d4c08c316d2-kube-api-access-bbg7p\") pod \"tuned-szrm5\" (UID: \"caf8d342-8fe1-461f-96d1-9d4c08c316d2\") " pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.669890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.669825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxql\" (UniqueName: \"kubernetes.io/projected/8ec34282-86a0-4ff0-874d-472781358e5d-kube-api-access-nsxql\") pod \"iptables-alerter-j6wv4\" (UID: \"8ec34282-86a0-4ff0-874d-472781358e5d\") " pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.670793 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.670772    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cq5q\" (UniqueName: \"kubernetes.io/projected/20f82749-da03-4eb3-81f6-69743f8f46f7-kube-api-access-5cq5q\") pod \"aws-ebs-csi-driver-node-twslf\" (UID: \"20f82749-da03-4eb3-81f6-69743f8f46f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.671002 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.670987    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fd9k\" (UniqueName: \"kubernetes.io/projected/26eb2796-9605-4cc2-8572-0516533f8bfb-kube-api-access-2fd9k\") pod \"ovnkube-node-kvbrv\" (UID: \"26eb2796-9605-4cc2-8572-0516533f8bfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.671200 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.671182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlqff\" (UniqueName: \"kubernetes.io/projected/4939047a-a472-4db4-bef0-7d3a0a114182-kube-api-access-rlqff\") pod \"multus-additional-cni-plugins-bsd5k\" (UID: \"4939047a-a472-4db4-bef0-7d3a0a114182\") " pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.671278 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.671210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxfjb\" (UniqueName: \"kubernetes.io/projected/558744a4-2048-41cb-a017-a9a02e133112-kube-api-access-fxfjb\") pod \"node-ca-zhn9k\" (UID: \"558744a4-2048-41cb-a017-a9a02e133112\") " pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.671425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.671408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5sp\" (UniqueName: \"kubernetes.io/projected/64455557-0e0d-4f7a-8a7f-de5351a3f2b4-kube-api-access-4j5sp\") pod \"multus-trncw\" (UID: \"64455557-0e0d-4f7a-8a7f-de5351a3f2b4\") " pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.671553 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.671538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf75l\" (UniqueName: \"kubernetes.io/projected/323ceb42-e486-41f7-b456-ec33939b321f-kube-api-access-hf75l\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:52.753161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.753081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zlxf4"
Jul 08 04:18:52.759093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.759063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:18:52.761693 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.761666    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8696742d_36e5_4f6e_b22d_f944a329796b.slice/crio-301312fd70de18ca868b83ce657dc5a8bc20c8a7191bcc7dc23d5ac20e4a61a1 WatchSource:0}: Error finding container 301312fd70de18ca868b83ce657dc5a8bc20c8a7191bcc7dc23d5ac20e4a61a1: Status 404 returned error can't find the container with id 301312fd70de18ca868b83ce657dc5a8bc20c8a7191bcc7dc23d5ac20e4a61a1
Jul 08 04:18:52.766708 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.766687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j6wv4"
Jul 08 04:18:52.767016 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.766957    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8fa9f0_c0fd_4b15_8d71_25b5fb091424.slice/crio-c6ff7524486102e4664e37274b62fa36d411545a605431c0190390021757811a WatchSource:0}: Error finding container c6ff7524486102e4664e37274b62fa36d411545a605431c0190390021757811a: Status 404 returned error can't find the container with id c6ff7524486102e4664e37274b62fa36d411545a605431c0190390021757811a
Jul 08 04:18:52.771451 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.771423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:18:52.773644 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.773622    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec34282_86a0_4ff0_874d_472781358e5d.slice/crio-90fad31616a166e9922103217304663f4c402ad1a0be769d75975ffa04248c1d WatchSource:0}: Error finding container 90fad31616a166e9922103217304663f4c402ad1a0be769d75975ffa04248c1d: Status 404 returned error can't find the container with id 90fad31616a166e9922103217304663f4c402ad1a0be769d75975ffa04248c1d
Jul 08 04:18:52.775464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.775448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf"
Jul 08 04:18:52.778708 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.778687    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26eb2796_9605_4cc2_8572_0516533f8bfb.slice/crio-c520ab6b9cab1dc4b487b7086b7d89ac2e68a57cbf9eef1dec1edf153cba185c WatchSource:0}: Error finding container c520ab6b9cab1dc4b487b7086b7d89ac2e68a57cbf9eef1dec1edf153cba185c: Status 404 returned error can't find the container with id c520ab6b9cab1dc4b487b7086b7d89ac2e68a57cbf9eef1dec1edf153cba185c
Jul 08 04:18:52.779228 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.779189    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:18:52.779638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.779619    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/1.log"
Jul 08 04:18:52.780013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.779995    2562 generic.go:356] "Generic (PLEG): container finished" podID="eefaa663ec39fc89d19e48763868a1f4" containerID="e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456" exitCode=1
Jul 08 04:18:52.780091 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.780061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerDied","Data":"e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456"}
Jul 08 04:18:52.780147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.780130    2562 scope.go:117] "RemoveContainer" containerID="dcca801358ac44a5cfd6bcff396026e77bde999ae650f998f5e7d95fe9cb0d27"
Jul 08 04:18:52.780282 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.780263    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szrm5"
Jul 08 04:18:52.780421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.780400    2562 scope.go:117] "RemoveContainer" containerID="e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456"
Jul 08 04:18:52.780562 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:52.780541    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podUID="eefaa663ec39fc89d19e48763868a1f4"
Jul 08 04:18:52.781585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.781568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j6wv4" event={"ID":"8ec34282-86a0-4ff0-874d-472781358e5d","Type":"ContainerStarted","Data":"90fad31616a166e9922103217304663f4c402ad1a0be769d75975ffa04248c1d"}
Jul 08 04:18:52.782526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.782504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4t99r" event={"ID":"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424","Type":"ContainerStarted","Data":"c6ff7524486102e4664e37274b62fa36d411545a605431c0190390021757811a"}
Jul 08 04:18:52.785425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.785300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bsd5k"
Jul 08 04:18:52.786107 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.786087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zlxf4" event={"ID":"8696742d-36e5-4f6e-b22d-f944a329796b","Type":"ContainerStarted","Data":"301312fd70de18ca868b83ce657dc5a8bc20c8a7191bcc7dc23d5ac20e4a61a1"}
Jul 08 04:18:52.788462 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.788432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f82749_da03_4eb3_81f6_69743f8f46f7.slice/crio-eb6709a66a8d7d426abb46a85b81235b9b8f0506c939f24255e305cddf96b0ca WatchSource:0}: Error finding container eb6709a66a8d7d426abb46a85b81235b9b8f0506c939f24255e305cddf96b0ca: Status 404 returned error can't find the container with id eb6709a66a8d7d426abb46a85b81235b9b8f0506c939f24255e305cddf96b0ca
Jul 08 04:18:52.790887 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.790850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zhn9k"
Jul 08 04:18:52.793836 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.793670    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf8d342_8fe1_461f_96d1_9d4c08c316d2.slice/crio-b501314d3a6f187e726452e6e3f4c76a0480b2660e360f3484e9580a6952e22b WatchSource:0}: Error finding container b501314d3a6f187e726452e6e3f4c76a0480b2660e360f3484e9580a6952e22b: Status 404 returned error can't find the container with id b501314d3a6f187e726452e6e3f4c76a0480b2660e360f3484e9580a6952e22b
Jul 08 04:18:52.794809 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:52.794687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-trncw"
Jul 08 04:18:52.794809 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.794801    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4939047a_a472_4db4_bef0_7d3a0a114182.slice/crio-2379ea097281b00a5a2258bce624e8aa4e005d8655e1e5528b602a439079d42f WatchSource:0}: Error finding container 2379ea097281b00a5a2258bce624e8aa4e005d8655e1e5528b602a439079d42f: Status 404 returned error can't find the container with id 2379ea097281b00a5a2258bce624e8aa4e005d8655e1e5528b602a439079d42f
Jul 08 04:18:52.802110 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.802090    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558744a4_2048_41cb_a017_a9a02e133112.slice/crio-22ed79d734b4f6a9a115ec316083996502d94fef7403792717866bc395fa95ac WatchSource:0}: Error finding container 22ed79d734b4f6a9a115ec316083996502d94fef7403792717866bc395fa95ac: Status 404 returned error can't find the container with id 22ed79d734b4f6a9a115ec316083996502d94fef7403792717866bc395fa95ac
Jul 08 04:18:52.804526 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:18:52.804510    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64455557_0e0d_4f7a_8a7f_de5351a3f2b4.slice/crio-32c4a012055f2fd7c4143cbadc7560971c64e06ba00b9dcf89a69b33b8924319 WatchSource:0}: Error finding container 32c4a012055f2fd7c4143cbadc7560971c64e06ba00b9dcf89a69b33b8924319: Status 404 returned error can't find the container with id 32c4a012055f2fd7c4143cbadc7560971c64e06ba00b9dcf89a69b33b8924319
Jul 08 04:18:53.166583 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.166488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:53.166739 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.166629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:53.166739 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.166639    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:53.166739 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.166705    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:54.166689329 +0000 UTC m=+25.087317780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:53.166909 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.166782    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:53.166909 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.166839    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:18:54.166823904 +0000 UTC m=+25.087452360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:53.267930 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.267448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:53.267930 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.267618    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:18:53.267930 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.267637    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:18:53.267930 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.267648    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:53.267930 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.267735    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:54.267688904 +0000 UTC m=+25.188317358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:53.495030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.494933    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 04:13:52 +0000 UTC" deadline="2028-03-12 08:11:43.407821731 +0000 UTC"
Jul 08 04:18:53.495030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.494981    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14715h52m49.912846417s"
Jul 08 04:18:53.732693 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.732661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:53.732898 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.732794    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:18:53.804790 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.804586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-trncw" event={"ID":"64455557-0e0d-4f7a-8a7f-de5351a3f2b4","Type":"ContainerStarted","Data":"32c4a012055f2fd7c4143cbadc7560971c64e06ba00b9dcf89a69b33b8924319"}
Jul 08 04:18:53.811757 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.811717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zhn9k" event={"ID":"558744a4-2048-41cb-a017-a9a02e133112","Type":"ContainerStarted","Data":"22ed79d734b4f6a9a115ec316083996502d94fef7403792717866bc395fa95ac"}
Jul 08 04:18:53.822654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.822555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerStarted","Data":"2379ea097281b00a5a2258bce624e8aa4e005d8655e1e5528b602a439079d42f"}
Jul 08 04:18:53.827629 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.827596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf" event={"ID":"20f82749-da03-4eb3-81f6-69743f8f46f7","Type":"ContainerStarted","Data":"eb6709a66a8d7d426abb46a85b81235b9b8f0506c939f24255e305cddf96b0ca"}
Jul 08 04:18:53.831746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.831717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"c520ab6b9cab1dc4b487b7086b7d89ac2e68a57cbf9eef1dec1edf153cba185c"}
Jul 08 04:18:53.841762 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.841669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:18:53.844562 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.843954    2562 scope.go:117] "RemoveContainer" containerID="e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456"
Jul 08 04:18:53.844562 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:53.844136    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podUID="eefaa663ec39fc89d19e48763868a1f4"
Jul 08 04:18:53.850556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:53.850504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szrm5" event={"ID":"caf8d342-8fe1-461f-96d1-9d4c08c316d2","Type":"ContainerStarted","Data":"b501314d3a6f187e726452e6e3f4c76a0480b2660e360f3484e9580a6952e22b"}
Jul 08 04:18:54.176428 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.176343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:54.176428 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.176395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:54.176656 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.176557    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:54.176656 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.176632    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:18:56.176600793 +0000 UTC m=+27.097229267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:54.177046 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.177026    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:54.177132 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.177085    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:56.17707001 +0000 UTC m=+27.097698475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:54.278094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.277391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:54.278094 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.277593    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:18:54.278094 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.277614    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:18:54.278094 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.277628    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:54.278094 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.277685    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:18:56.277664681 +0000 UTC m=+27.198293134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:54.495703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.495607    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 04:13:52 +0000 UTC" deadline="2028-02-12 12:54:13.440736624 +0000 UTC"
Jul 08 04:18:54.495703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.495645    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14024h35m18.945096112s"
Jul 08 04:18:54.723165 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.723132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:54.723360 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.723265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:18:54.723703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:54.723657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:54.723854 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:54.723765    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:18:55.726469 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:55.725045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:55.726469 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:55.725178    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:18:56.194432 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:56.194347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:56.194561 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:56.194453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:56.194561 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.194520    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:56.194561 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.194555    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:56.194666 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.194580    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:19:00.194564892 +0000 UTC m=+31.115193343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:18:56.194666 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.194610    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:00.194593172 +0000 UTC m=+31.115221639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:18:56.295020 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:56.294981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:56.295219 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.295201    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:18:56.295294 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.295227    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:18:56.295294 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.295240    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:56.295406 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.295305    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:00.295285165 +0000 UTC m=+31.215913641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:18:56.723243 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:56.723178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:56.723636 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.723323    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:18:56.723724 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:56.723694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:56.723830 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:56.723779    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:18:57.723076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:57.722948    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:57.723521 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:57.723094    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:18:58.722658 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:58.722625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:18:58.722890 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:58.722758    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:18:58.722890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:58.722802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:18:58.723010 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:58.722951    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:18:59.724595 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:18:59.724160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:18:59.724595 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:18:59.724262    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:00.228119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:00.228173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.228318    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.228364    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.228380    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:19:08.228361044 +0000 UTC m=+39.148989500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:00.228539 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.228457    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:08.228435227 +0000 UTC m=+39.149063678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:00.329308 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:00.329267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:00.329489 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.329471    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:19:00.329551 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.329496    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:19:00.329551 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.329510    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:00.329642 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.329578    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:08.32955917 +0000 UTC m=+39.250187623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:00.722765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:00.722444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:00.722765 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.722595    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:00.722765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:00.722661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:00.722765 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:00.722730    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:01.722962 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:01.722924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:01.723402 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:01.723109    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:02.722944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:02.722905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:02.723128 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:02.722908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:02.723128 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:02.723043    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:02.723128 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:02.723077    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:03.723183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:03.723144    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:03.723613 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:03.723281    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:04.722355 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:04.722323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:04.722530 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:04.722320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:04.722530 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:04.722445    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:04.722626 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:04.722546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:05.072221 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.072144    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nrds6"]
Jul 08 04:19:05.075072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.075048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.077921 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.077896    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 04:19:05.078040 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.077951    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 04:19:05.078040 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.077900    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 04:19:05.078159 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.078145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 04:19:05.078233 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.078220    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 04:19:05.078936 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.078918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-grz7w\""
Jul 08 04:19:05.079056 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.078961    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 04:19:05.166980 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.166934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-metrics-client-ca\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.166988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-sys\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-wtmp\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-root\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klj6h\" (UniqueName: \"kubernetes.io/projected/23cd9438-a4a0-4973-9c0b-56054fa0c56b-kube-api-access-klj6h\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.167426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.167282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-textfile\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268344 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klj6h\" (UniqueName: \"kubernetes.io/projected/23cd9438-a4a0-4973-9c0b-56054fa0c56b-kube-api-access-klj6h\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268344 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-textfile\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-metrics-client-ca\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-sys\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-wtmp\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-root\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268585 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268920 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268732    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-root\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268920 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-sys\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.268920 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-textfile\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.269072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.268935    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-wtmp\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.269072 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:05.268941    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 04:19:05.269072 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:05.269052    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls podName:23cd9438-a4a0-4973-9c0b-56054fa0c56b nodeName:}" failed. No retries permitted until 2026-07-08 04:19:05.769029423 +0000 UTC m=+36.689657890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls") pod "node-exporter-nrds6" (UID: "23cd9438-a4a0-4973-9c0b-56054fa0c56b") : secret "node-exporter-tls" not found
Jul 08 04:19:05.269220 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.269084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-metrics-client-ca\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.269220 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.269108    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.272467 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.272271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.279401 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.279368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klj6h\" (UniqueName: \"kubernetes.io/projected/23cd9438-a4a0-4973-9c0b-56054fa0c56b-kube-api-access-klj6h\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.723171 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.723140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:05.723366 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:05.723266    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:05.771273 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:05.771238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:05.771421 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:05.771364    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 04:19:05.771474 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:05.771434    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls podName:23cd9438-a4a0-4973-9c0b-56054fa0c56b nodeName:}" failed. No retries permitted until 2026-07-08 04:19:06.771413955 +0000 UTC m=+37.692042414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls") pod "node-exporter-nrds6" (UID: "23cd9438-a4a0-4973-9c0b-56054fa0c56b") : secret "node-exporter-tls" not found
Jul 08 04:19:06.722325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:06.722284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:06.722805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:06.722298    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:06.722805 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:06.722450    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:06.722805 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:06.722501    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:06.779587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:06.779539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:06.782021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:06.781995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23cd9438-a4a0-4973-9c0b-56054fa0c56b-node-exporter-tls\") pod \"node-exporter-nrds6\" (UID: \"23cd9438-a4a0-4973-9c0b-56054fa0c56b\") " pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:06.884228 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:06.884196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nrds6"
Jul 08 04:19:07.722515 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:07.722477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:07.723016 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:07.722627    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:07.723095 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:07.723060    2562 scope.go:117] "RemoveContainer" containerID="e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456"
Jul 08 04:19:07.723253 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:07.723234    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_openshift-machine-config-operator(eefaa663ec39fc89d19e48763868a1f4)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podUID="eefaa663ec39fc89d19e48763868a1f4"
Jul 08 04:19:08.291021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:08.290981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:08.291021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:08.291025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:08.291234 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.291142    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:08.291234 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.291191    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:19:24.291177187 +0000 UTC m=+55.211805638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:08.291234 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.291143    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:08.291379 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.291285    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:24.291265906 +0000 UTC m=+55.211894370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:08.392192 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:08.392154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:08.392357 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.392308    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:19:08.392357 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.392325    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:19:08.392357 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.392336    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:08.392488 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.392395    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:24.39237727 +0000 UTC m=+55.313005725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:08.723063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:08.723024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:08.723470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:08.723024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:08.723470 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.723173    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:08.723470 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:08.723245    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:09.723878 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:09.723821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:09.724309 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:09.723958    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:10.723015 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:10.722970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:10.723222 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:10.723097    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:10.723222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:10.723144    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:10.723332 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:10.723241    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:11.723665 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.723061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:11.723665 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:11.723208    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:11.896066 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.896027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szrm5" event={"ID":"caf8d342-8fe1-461f-96d1-9d4c08c316d2","Type":"ContainerStarted","Data":"6fe1e64e2a7a6f528a5c1ef185659770e6bad1e81a62a83c6a787fdea0f30f49"}
Jul 08 04:19:11.897692 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.897664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrds6" event={"ID":"23cd9438-a4a0-4973-9c0b-56054fa0c56b","Type":"ContainerStarted","Data":"dc91276a13fa8506cf086f3b9d1455cbd592f19fc8d623f3a9a4ab0d3497b08f"}
Jul 08 04:19:11.899344 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.899314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4t99r" event={"ID":"8c8fa9f0-c0fd-4b15-8d71-25b5fb091424","Type":"ContainerStarted","Data":"7c256f97f2f83cdfae705dcc90b46a62588b6467436f14e716c583b5ff803fdb"}
Jul 08 04:19:11.901022 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.901002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-trncw" event={"ID":"64455557-0e0d-4f7a-8a7f-de5351a3f2b4","Type":"ContainerStarted","Data":"9cf3ea0d32b26e1df7dfa15eb2c4ae6e4dbd1d7281eb9ed127a75297ddfe3cde"}
Jul 08 04:19:11.903304 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.902563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zhn9k" event={"ID":"558744a4-2048-41cb-a017-a9a02e133112","Type":"ContainerStarted","Data":"996023a4fb69ad9a32d08077bece60b96fa23af3c7d5ec2bf0e7289bf4ded5e6"}
Jul 08 04:19:11.904797 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.904770    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="e9a0e5a8eefc5e6b9dde6ea3d30b41079410bf9d2506a9afea39c69f204c5ce6" exitCode=0
Jul 08 04:19:11.904931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.904848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"e9a0e5a8eefc5e6b9dde6ea3d30b41079410bf9d2506a9afea39c69f204c5ce6"}
Jul 08 04:19:11.906664 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.906633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf" event={"ID":"20f82749-da03-4eb3-81f6-69743f8f46f7","Type":"ContainerStarted","Data":"db69a76eb5614b5cdcd7563abad02d89d8694ba64e4ee64841dd23d955084571"}
Jul 08 04:19:11.910366 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"22a4b6732b22325f2c9cc055b8fe31c3c80f984f467b48e3ce80bda86c4b8d32"}
Jul 08 04:19:11.910457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"54daddc423d092d84bbf42bfccaced125f178316c15fcbff21938e70a4be60d0"}
Jul 08 04:19:11.910522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"7ed55178c13920e3d3fb654c0c161edef91c39bfc1c496296d4a7bfb23cff49a"}
Jul 08 04:19:11.910522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"f6c8f556228431d2d0f5eedc63fdadbd161d82eee1f970ddd2345d23a5579c2a"}
Jul 08 04:19:11.910638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"8d7a5870e06a15efba7f57ba2a798c3f6567152b7cce051949da0f393f98c0ed"}
Jul 08 04:19:11.910638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.910579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"05f9ba5e125a2ccfdf495d7d0612f90efccc3a2f9eeaabe35b3c424ba7c7d758"}
Jul 08 04:19:11.911754 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.911734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zlxf4" event={"ID":"8696742d-36e5-4f6e-b22d-f944a329796b","Type":"ContainerStarted","Data":"95f90dd50a47aaf9aea9136116c1adfa0773f7977ae168b2a21022aa2770123b"}
Jul 08 04:19:11.913613 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.913565    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szrm5" podStartSLOduration=4.46209795 podStartE2EDuration="22.913553405s" totalImagesPullingTime="18.451455455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:11.91304567 +0000 UTC m=+42.833674153" watchObservedRunningTime="2026-07-08 04:19:11.913553405 +0000 UTC m=+42.834181924"
Jul 08 04:19:11.946987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.946893    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4t99r" podStartSLOduration=8.777332702 podStartE2EDuration="22.946854329s" totalImagesPullingTime="14.169521627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:11.945955669 +0000 UTC m=+42.866584153" watchObservedRunningTime="2026-07-08 04:19:11.946854329 +0000 UTC m=+42.867482804"
Jul 08 04:19:11.959395 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.959342    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zhn9k" podStartSLOduration=4.522227314 podStartE2EDuration="22.959330194s" totalImagesPullingTime="18.43710288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:11.959004797 +0000 UTC m=+42.879633271" watchObservedRunningTime="2026-07-08 04:19:11.959330194 +0000 UTC m=+42.879958667"
Jul 08 04:19:11.975706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.975643    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-trncw" podStartSLOduration=4.495883751 podStartE2EDuration="22.975626538s" totalImagesPullingTime="18.479742787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:11.975146724 +0000 UTC m=+42.895775199" watchObservedRunningTime="2026-07-08 04:19:11.975626538 +0000 UTC m=+42.896255011"
Jul 08 04:19:11.990745 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:11.990688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zlxf4" podStartSLOduration=4.513572488 podStartE2EDuration="22.990666496s" totalImagesPullingTime="18.477094008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:11.989677647 +0000 UTC m=+42.910306120" watchObservedRunningTime="2026-07-08 04:19:11.990666496 +0000 UTC m=+42.911294971"
Jul 08 04:19:12.044281 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.044001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:12.126738 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.126706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:12.225927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.225895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:12.499502 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.499463    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 04:19:12.584106 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.583998    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T04:19:12.49948282Z","UUID":"cdecfd63-4bd3-4f2b-a1c2-2adf1d8fcfb9","Handler":null,"Name":"","Endpoint":""}
Jul 08 04:19:12.585436 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.585416    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 04:19:12.585543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.585450    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 04:19:12.722473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.722442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:12.722658 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:12.722558    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:12.722658 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.722623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:12.722782 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:12.722758    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:12.759924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.759892    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:19:12.760582 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.760520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:19:12.917094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.917053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j6wv4" event={"ID":"8ec34282-86a0-4ff0-874d-472781358e5d","Type":"ContainerStarted","Data":"60acf1e619e258622bd2004aff92f9a7f7331b37103c2643b095946ef7569de0"}
Jul 08 04:19:12.919138 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.919102    2562 generic.go:356] "Generic (PLEG): container finished" podID="23cd9438-a4a0-4973-9c0b-56054fa0c56b" containerID="ee13d7aee5855a97f02eec9f8bcbec08b423441b669ee38188d812859ff7daad" exitCode=0
Jul 08 04:19:12.919415 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.919391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrds6" event={"ID":"23cd9438-a4a0-4973-9c0b-56054fa0c56b","Type":"ContainerDied","Data":"ee13d7aee5855a97f02eec9f8bcbec08b423441b669ee38188d812859ff7daad"}
Jul 08 04:19:12.922115 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.922085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf" event={"ID":"20f82749-da03-4eb3-81f6-69743f8f46f7","Type":"ContainerStarted","Data":"1d11dd8cbaf3c01f5d314a0bbac023b6edfa2193f95fcaaa617246576d2dc6b8"}
Jul 08 04:19:12.950816 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:12.950758    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j6wv4" podStartSLOduration=5.477703208 podStartE2EDuration="23.950736132s" totalImagesPullingTime="18.473032924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:12.933203998 +0000 UTC m=+43.853832482" watchObservedRunningTime="2026-07-08 04:19:12.950736132 +0000 UTC m=+43.871364606"
Jul 08 04:19:13.050900 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.050847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:13.151641 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.151606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:13.722632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.722599    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:13.722787 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:13.722718    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:13.926840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.926796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf" event={"ID":"20f82749-da03-4eb3-81f6-69743f8f46f7","Type":"ContainerStarted","Data":"6a4d327226edd398b1e83b2e26c30c29963c6f388899815f9137034c35047f37"}
Jul 08 04:19:13.932304 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.932271    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"c875893e81b1f3f0b2b1f0b68646ff85fe6dde1718931100a278f63fb313bff5"}
Jul 08 04:19:13.934598 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.934565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrds6" event={"ID":"23cd9438-a4a0-4973-9c0b-56054fa0c56b","Type":"ContainerStarted","Data":"bc87855f7a1bfeb2e2da29b5bbda016086ed6d04c3ad87cfc3d6737ee2176e50"}
Jul 08 04:19:13.934741 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.934610    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 04:19:13.934741 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.934629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nrds6" event={"ID":"23cd9438-a4a0-4973-9c0b-56054fa0c56b","Type":"ContainerStarted","Data":"263b5577fdf5af5b1ffe5582a66d4b7250c8c55c56589562b4fceddbd460ae0f"}
Jul 08 04:19:13.943365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:13.943305    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twslf" podStartSLOduration=4.84878737 podStartE2EDuration="24.943290571s" totalImagesPullingTime="20.094503201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:13.943124881 +0000 UTC m=+44.863753353" watchObservedRunningTime="2026-07-08 04:19:13.943290571 +0000 UTC m=+44.863919041"
Jul 08 04:19:14.091075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.090988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.192582 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.192548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.291538 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.291503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.491604 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.491571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.550807 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.550772    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:19:14.551761 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.551735    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4t99r"
Jul 08 04:19:14.566359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.566298    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nrds6" podStartSLOduration=8.626144774 podStartE2EDuration="9.566274693s" totalImagesPullingTime="866.680914ms" totalInitContainerRuntime="73.449005ms" isStatefulPod=true podCreationTimestamp="2026-07-08 04:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:13.963707088 +0000 UTC m=+44.884335578" watchObservedRunningTime="2026-07-08 04:19:14.566274693 +0000 UTC m=+45.486903166"
Jul 08 04:19:14.570334 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.570306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.620825 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.620791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:14.722245 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.722203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:14.722413 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:14.722249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:14.722413 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:14.722337    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:14.722580 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:14.722476    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:15.723182 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:15.723148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:15.723813 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:15.723287    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:16.722651 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:16.722450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:16.722834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:16.722461    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:16.722834 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:16.722750    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:16.722969 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:16.722836    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:17.129134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.129044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:17.181283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.181253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:17.258782 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.258748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:17.360234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.360210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:17.722257 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.722232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:17.722412 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:17.722379    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:17.946242 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.946153    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="7775c8ee8402beeec8b72c164ff2d3c20890226c63b53640f066bda03cf2b31f" exitCode=0
Jul 08 04:19:17.946242 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.946232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"7775c8ee8402beeec8b72c164ff2d3c20890226c63b53640f066bda03cf2b31f"}
Jul 08 04:19:17.950052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.950029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" event={"ID":"26eb2796-9605-4cc2-8572-0516533f8bfb","Type":"ContainerStarted","Data":"a56434626919c6b7fed4c93fed9274aa73c8f77631d0d736c9e4f41f816501c4"}
Jul 08 04:19:17.950278 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.950260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:17.950385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.950327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:17.965594 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.965568    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:17.965728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.965678    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:17.991210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:17.991161    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv" podStartSLOduration=10.496474103 podStartE2EDuration="28.991146134s" totalImagesPullingTime="18.494672031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:17.990824993 +0000 UTC m=+48.911453466" watchObservedRunningTime="2026-07-08 04:19:17.991146134 +0000 UTC m=+48.911774647"
Jul 08 04:19:18.722592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:18.722550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:18.723140 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:18.722683    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:18.723140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:18.723006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:18.723140 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:18.723107    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:18.952714 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:18.952680    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.300117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2dzz"]
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.300509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:19.300635    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.300662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7jlc"]
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.300777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:19.302086 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:19.300923    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:19.302553 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.302529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6sw9w"]
Jul 08 04:19:19.303046 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.303025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:19.303157 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:19.303116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:19.615238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.615150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:19.716715 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.716684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:19.957402 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.957325    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="ffa78f561d8e8cbf1dd2defaa257176b70b952ce566fb53e66c58f96cdeadd9c" exitCode=0
Jul 08 04:19:19.958074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.957393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"ffa78f561d8e8cbf1dd2defaa257176b70b952ce566fb53e66c58f96cdeadd9c"}
Jul 08 04:19:19.958074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:19.957497    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 04:19:20.034268 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.034229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:20.723030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.722995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:20.723030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.723025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:20.723247 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.723026    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:20.723247 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:20.723132    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:20.723247 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:20.723187    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:20.723377 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:20.723286    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:20.962161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.962077    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="67006e0566e7174f17c9a1672f6d736df32c31d82d583d4ca828cfb369a5d015" exitCode=0
Jul 08 04:19:20.962641 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:20.962159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"67006e0566e7174f17c9a1672f6d736df32c31d82d583d4ca828cfb369a5d015"}
Jul 08 04:19:21.723456 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:21.723425    2562 scope.go:117] "RemoveContainer" containerID="e71ac4e515eb15d20e3b9f731f66a4f294bf86acd897b97e46c2b4cc7f3b3456"
Jul 08 04:19:21.967195 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:21.966947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:19:21.967921 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:21.967884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" event={"ID":"eefaa663ec39fc89d19e48763868a1f4","Type":"ContainerStarted","Data":"af27c15caf7952d8b00a88a681ba9f898715048ad090808a291f79cdb81dd400"}
Jul 08 04:19:21.982755 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:21.982618    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal" podStartSLOduration=30.982597542 podStartE2EDuration="30.982597542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:21.982140554 +0000 UTC m=+52.902769044" watchObservedRunningTime="2026-07-08 04:19:21.982597542 +0000 UTC m=+52.903226018"
Jul 08 04:19:22.723191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:22.723155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:22.723436 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:22.723270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2dzz" podUID="8f3d653f-60c9-4f73-85d3-d4124b1861ea"
Jul 08 04:19:22.723436 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:22.723166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:22.723436 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:22.723174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:22.723607 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:22.723429    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6sw9w" podUID="323ceb42-e486-41f7-b456-ec33939b321f"
Jul 08 04:19:22.723607 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:22.723480    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7jlc" podUID="bc934de8-65ae-4ed9-85ed-2c25b3dedd5f"
Jul 08 04:19:23.316735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.316696    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-106.ec2.internal" event="NodeReady"
Jul 08 04:19:23.317148 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.316886    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 04:19:23.361656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.361623    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zk9vj"]
Jul 08 04:19:23.381449 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.381382    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rkc8x"]
Jul 08 04:19:23.381618 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.381511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.384526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.384495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 04:19:23.384782 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.384766    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 04:19:23.385025 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.385011    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v9th6\""
Jul 08 04:19:23.385274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.385261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 04:19:23.397480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.397450    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zk9vj"]
Jul 08 04:19:23.397602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.397493    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rkc8x"]
Jul 08 04:19:23.397602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.397525    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vhwrn"]
Jul 08 04:19:23.397987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.397966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.400690 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.400664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 04:19:23.400835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.400804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6rbmt\""
Jul 08 04:19:23.400835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.400829    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 04:19:23.401129 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.401115    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 04:19:23.401216 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.401175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 04:19:23.417600 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.417571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vhwrn"]
Jul 08 04:19:23.417740 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.417685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.420203 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.420171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 04:19:23.420379 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.420259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 04:19:23.420379 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.420259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xh8sv\""
Jul 08 04:19:23.465827 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.465799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:23.503888 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.503842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.503888 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.503892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8ff090-e9d6-410a-80c7-112fd304d280-tmp-dir\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.503911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4166f690-b9aa-4e88-a5c7-c70490e73d66-cert\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.503958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1da6069-aeae-4676-ad9e-5a3706d39b82-data-volume\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.503992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6fj\" (UniqueName: \"kubernetes.io/projected/ef8ff090-e9d6-410a-80c7-112fd304d280-kube-api-access-kh6fj\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqv9\" (UniqueName: \"kubernetes.io/projected/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-api-access-grqv9\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef8ff090-e9d6-410a-80c7-112fd304d280-config-volume\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8ff090-e9d6-410a-80c7-112fd304d280-metrics-tls\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrz8j\" (UniqueName: \"kubernetes.io/projected/4166f690-b9aa-4e88-a5c7-c70490e73d66-kube-api-access-zrz8j\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1da6069-aeae-4676-ad9e-5a3706d39b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.504238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.504129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1da6069-aeae-4676-ad9e-5a3706d39b82-crio-socket\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.605554 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1da6069-aeae-4676-ad9e-5a3706d39b82-data-volume\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.605554 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6fj\" (UniqueName: \"kubernetes.io/projected/ef8ff090-e9d6-410a-80c7-112fd304d280-kube-api-access-kh6fj\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.605554 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqv9\" (UniqueName: \"kubernetes.io/projected/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-api-access-grqv9\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef8ff090-e9d6-410a-80c7-112fd304d280-config-volume\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8ff090-e9d6-410a-80c7-112fd304d280-metrics-tls\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrz8j\" (UniqueName: \"kubernetes.io/projected/4166f690-b9aa-4e88-a5c7-c70490e73d66-kube-api-access-zrz8j\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1da6069-aeae-4676-ad9e-5a3706d39b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1da6069-aeae-4676-ad9e-5a3706d39b82-crio-socket\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.605822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.606193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8ff090-e9d6-410a-80c7-112fd304d280-tmp-dir\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.606193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.605851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4166f690-b9aa-4e88-a5c7-c70490e73d66-cert\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.606193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.606023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1da6069-aeae-4676-ad9e-5a3706d39b82-data-volume\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.606361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.606238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1da6069-aeae-4676-ad9e-5a3706d39b82-crio-socket\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.606416 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.606355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef8ff090-e9d6-410a-80c7-112fd304d280-config-volume\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.606547 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.606520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8ff090-e9d6-410a-80c7-112fd304d280-tmp-dir\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.606714 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.606695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.610255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.610233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef8ff090-e9d6-410a-80c7-112fd304d280-metrics-tls\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.610255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.610246    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1da6069-aeae-4676-ad9e-5a3706d39b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.610446 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.610416    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4166f690-b9aa-4e88-a5c7-c70490e73d66-cert\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.614301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.614272    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6fj\" (UniqueName: \"kubernetes.io/projected/ef8ff090-e9d6-410a-80c7-112fd304d280-kube-api-access-kh6fj\") pod \"dns-default-vhwrn\" (UID: \"ef8ff090-e9d6-410a-80c7-112fd304d280\") " pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:23.614422 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.614275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqv9\" (UniqueName: \"kubernetes.io/projected/e1da6069-aeae-4676-ad9e-5a3706d39b82-kube-api-access-grqv9\") pod \"insights-runtime-extractor-rkc8x\" (UID: \"e1da6069-aeae-4676-ad9e-5a3706d39b82\") " pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.614492 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.614465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrz8j\" (UniqueName: \"kubernetes.io/projected/4166f690-b9aa-4e88-a5c7-c70490e73d66-kube-api-access-zrz8j\") pod \"ingress-canary-zk9vj\" (UID: \"4166f690-b9aa-4e88-a5c7-c70490e73d66\") " pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.695086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.695048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zk9vj"
Jul 08 04:19:23.708407 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.708372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rkc8x"
Jul 08 04:19:23.727792 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:23.727765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:24.093375 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.093341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:24.194646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.194613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.311001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.311049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.311172    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.311182    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.311234    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret podName:8f3d653f-60c9-4f73-85d3-d4124b1861ea nodeName:}" failed. No retries permitted until 2026-07-08 04:19:56.311217132 +0000 UTC m=+87.231845587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret") pod "global-pull-secret-syncer-x2dzz" (UID: "8f3d653f-60c9-4f73-85d3-d4124b1861ea") : object "kube-system"/"original-pull-secret" not registered
Jul 08 04:19:24.311383 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.311250    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs podName:323ceb42-e486-41f7-b456-ec33939b321f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:56.311243374 +0000 UTC m=+87.231871825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs") pod "network-metrics-daemon-6sw9w" (UID: "323ceb42-e486-41f7-b456-ec33939b321f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 04:19:24.412266 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.412185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:24.412712 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.412382    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 04:19:24.412712 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.412414    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 04:19:24.412712 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.412431    2562 projected.go:196] Error preparing data for projected volume kube-api-access-rm2zg for pod openshift-network-diagnostics/network-check-target-z7jlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:24.412712 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:19:24.412490    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg podName:bc934de8-65ae-4ed9-85ed-2c25b3dedd5f nodeName:}" failed. No retries permitted until 2026-07-08 04:19:56.412472349 +0000 UTC m=+87.333100801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rm2zg" (UniqueName: "kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg") pod "network-check-target-z7jlc" (UID: "bc934de8-65ae-4ed9-85ed-2c25b3dedd5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 04:19:24.722797 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.722761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:24.723006 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.722761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:24.723006 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.722763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:24.726369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726345    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbjls\""
Jul 08 04:19:24.726369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726370    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 04:19:24.726369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gp6ks\""
Jul 08 04:19:24.726681 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 04:19:24.726753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726704    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 04:19:24.726753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.726734    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 04:19:24.852931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.852893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:24.953136 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:24.953096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:25.287643 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.287408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zk9vj"]
Jul 08 04:19:25.293281 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.293256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vhwrn"]
Jul 08 04:19:25.300547 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.300524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rkc8x"]
Jul 08 04:19:25.374942 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:25.374841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4166f690_b9aa_4e88_a5c7_c70490e73d66.slice/crio-96dd1f322b30040f14e9e7c694679b1c56393e2844eb48ffc80cab0efd3f3587 WatchSource:0}: Error finding container 96dd1f322b30040f14e9e7c694679b1c56393e2844eb48ffc80cab0efd3f3587: Status 404 returned error can't find the container with id 96dd1f322b30040f14e9e7c694679b1c56393e2844eb48ffc80cab0efd3f3587
Jul 08 04:19:25.375227 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:25.375200    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8ff090_e9d6_410a_80c7_112fd304d280.slice/crio-f6f7ac56aa3a5f3136c90d4f3ec56b26795ea56414a64e8287112d7a56fb2131 WatchSource:0}: Error finding container f6f7ac56aa3a5f3136c90d4f3ec56b26795ea56414a64e8287112d7a56fb2131: Status 404 returned error can't find the container with id f6f7ac56aa3a5f3136c90d4f3ec56b26795ea56414a64e8287112d7a56fb2131
Jul 08 04:19:25.376441 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:25.376410    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1da6069_aeae_4676_ad9e_5a3706d39b82.slice/crio-cee5df7ca87a6edc2edf532ae944b5b2073e30e05940d7bd6718bc7d72b06f54 WatchSource:0}: Error finding container cee5df7ca87a6edc2edf532ae944b5b2073e30e05940d7bd6718bc7d72b06f54: Status 404 returned error can't find the container with id cee5df7ca87a6edc2edf532ae944b5b2073e30e05940d7bd6718bc7d72b06f54
Jul 08 04:19:25.980188 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.980144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkc8x" event={"ID":"e1da6069-aeae-4676-ad9e-5a3706d39b82","Type":"ContainerStarted","Data":"cee5df7ca87a6edc2edf532ae944b5b2073e30e05940d7bd6718bc7d72b06f54"}
Jul 08 04:19:25.981616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.981591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhwrn" event={"ID":"ef8ff090-e9d6-410a-80c7-112fd304d280","Type":"ContainerStarted","Data":"f6f7ac56aa3a5f3136c90d4f3ec56b26795ea56414a64e8287112d7a56fb2131"}
Jul 08 04:19:25.983846 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.983801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zk9vj" event={"ID":"4166f690-b9aa-4e88-a5c7-c70490e73d66","Type":"ContainerStarted","Data":"96dd1f322b30040f14e9e7c694679b1c56393e2844eb48ffc80cab0efd3f3587"}
Jul 08 04:19:25.989264 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.989228    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="b3813517020b4bc750ae5a936e821c0a5316fe1eda25657c965fc8244f01557d" exitCode=0
Jul 08 04:19:25.989382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:25.989272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"b3813517020b4bc750ae5a936e821c0a5316fe1eda25657c965fc8244f01557d"}
Jul 08 04:19:26.997426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:26.997147    2562 generic.go:356] "Generic (PLEG): container finished" podID="4939047a-a472-4db4-bef0-7d3a0a114182" containerID="f1fe8dab226457c40ad43020833476d8ed493d6da6bc73daf8cd3bb58b490f02" exitCode=0
Jul 08 04:19:26.997426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:26.997203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerDied","Data":"f1fe8dab226457c40ad43020833476d8ed493d6da6bc73daf8cd3bb58b490f02"}
Jul 08 04:19:28.692682 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:28.692649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:28.750059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:28.750028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:29.728592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:29.728409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:29.829295 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:29.829254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:30.528823 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:30.528786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:30.625321 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:30.625287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:31.015334 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:31.015288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:31.116438 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:31.116405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:31.485280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:31.485244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:31.537064 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:31.537036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:32.014991 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.014901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhwrn" event={"ID":"ef8ff090-e9d6-410a-80c7-112fd304d280","Type":"ContainerStarted","Data":"991ac0d95f32c5a44f47093740ba8ddaaa063a7a244aeab98dbeb4804418316b"}
Jul 08 04:19:32.014991 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.014978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhwrn" event={"ID":"ef8ff090-e9d6-410a-80c7-112fd304d280","Type":"ContainerStarted","Data":"3f8c635a0d2b12ebc67646a608e34d37c688b62af435d5be74b09e4f5d09ffb8"}
Jul 08 04:19:32.015198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.015010    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:32.016409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.016390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zk9vj" event={"ID":"4166f690-b9aa-4e88-a5c7-c70490e73d66","Type":"ContainerStarted","Data":"c4349276e53d8be53ccd77d2ab6c42d31535e79b91f848eac0c18353613328fa"}
Jul 08 04:19:32.021701 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.021672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" event={"ID":"4939047a-a472-4db4-bef0-7d3a0a114182","Type":"ContainerStarted","Data":"5fee0a4384066d0391e069e82715a9c39b0b53f73942865db262cc14cb1efe9e"}
Jul 08 04:19:32.023391 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.023367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkc8x" event={"ID":"e1da6069-aeae-4676-ad9e-5a3706d39b82","Type":"ContainerStarted","Data":"ecbc71c62779f48fe0a6a9cf494bda8a0e925318a2448c03040117110aadc39f"}
Jul 08 04:19:32.031238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.031194    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vhwrn" podStartSLOduration=2.989924076 podStartE2EDuration="9.031181895s" totalImagesPullingTime="6.041257819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:32.02979516 +0000 UTC m=+62.950423644" watchObservedRunningTime="2026-07-08 04:19:32.031181895 +0000 UTC m=+62.951810358"
Jul 08 04:19:32.050000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.049943    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bsd5k" podStartSLOduration=12.751604692 podStartE2EDuration="43.049926671s" totalImagesPullingTime="30.298321979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:32.04953216 +0000 UTC m=+62.970160633" watchObservedRunningTime="2026-07-08 04:19:32.049926671 +0000 UTC m=+62.970555143"
Jul 08 04:19:32.063453 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.063401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zk9vj" podStartSLOduration=3.014615138 podStartE2EDuration="9.063379566s" totalImagesPullingTime="6.048764428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:32.062439081 +0000 UTC m=+62.983067590" watchObservedRunningTime="2026-07-08 04:19:32.063379566 +0000 UTC m=+62.984008034"
Jul 08 04:19:32.167648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.167613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:32.222292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:32.222260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:33.029087 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:33.029043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkc8x" event={"ID":"e1da6069-aeae-4676-ad9e-5a3706d39b82","Type":"ContainerStarted","Data":"f32073a15165236c3b90901f48bdfe465661787e2e7b2228ec4d655b106265bb"}
Jul 08 04:19:36.040210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:36.040171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkc8x" event={"ID":"e1da6069-aeae-4676-ad9e-5a3706d39b82","Type":"ContainerStarted","Data":"80dd0c1147ab1f59d047b35bf65cfa3c4c5c86fba42bba0d3f5e5c7cb6eb0e9e"}
Jul 08 04:19:36.057265 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:36.057213    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rkc8x" podStartSLOduration=3.6205625980000002 podStartE2EDuration="13.057197584s" totalImagesPullingTime="9.436634986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:19:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:36.055840389 +0000 UTC m=+66.976468862" watchObservedRunningTime="2026-07-08 04:19:36.057197584 +0000 UTC m=+66.977826056"
Jul 08 04:19:39.121372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:39.121334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:39.219644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:39.219616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:42.031380 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:42.031348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vhwrn"
Jul 08 04:19:48.453028 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:48.452994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:48.506523 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:48.506487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:50.975292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:50.975266    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvbrv"
Jul 08 04:19:51.088013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:51.087900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:51.137504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:51.137469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:51.192969 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:51.192943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:52.476027 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:52.475996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zk9vj_4166f690-b9aa-4e88-a5c7-c70490e73d66/serve-healthcheck-canary/0.log"
Jul 08 04:19:54.561139 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:54.561103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:54.619748 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:54.619720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:56.370602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.370554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:56.370602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.370606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:56.373257 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.373240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 04:19:56.374040 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.374026    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 04:19:56.383970 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.383945    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f3d653f-60c9-4f73-85d3-d4124b1861ea-original-pull-secret\") pod \"global-pull-secret-syncer-x2dzz\" (UID: \"8f3d653f-60c9-4f73-85d3-d4124b1861ea\") " pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:56.383970 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.383958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/323ceb42-e486-41f7-b456-ec33939b321f-metrics-certs\") pod \"network-metrics-daemon-6sw9w\" (UID: \"323ceb42-e486-41f7-b456-ec33939b321f\") " pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:56.471488 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.471439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:56.473786 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.473756    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 04:19:56.484902 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.484877    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 04:19:56.494978 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.494951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm2zg\" (UniqueName: \"kubernetes.io/projected/bc934de8-65ae-4ed9-85ed-2c25b3dedd5f-kube-api-access-rm2zg\") pod \"network-check-target-z7jlc\" (UID: \"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f\") " pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:56.534579 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.534548    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2dzz"
Jul 08 04:19:56.545161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.545136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbjls\""
Jul 08 04:19:56.550645 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.550620    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gp6ks\""
Jul 08 04:19:56.552567 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.552544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:19:56.558742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.558718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6sw9w"
Jul 08 04:19:56.674526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.674464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2dzz"]
Jul 08 04:19:56.680433 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:56.680396    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3d653f_60c9_4f73_85d3_d4124b1861ea.slice/crio-4207dccb94181c8f61aeb707deb26ea7306917d89ec8685660337e63feaf863a WatchSource:0}: Error finding container 4207dccb94181c8f61aeb707deb26ea7306917d89ec8685660337e63feaf863a: Status 404 returned error can't find the container with id 4207dccb94181c8f61aeb707deb26ea7306917d89ec8685660337e63feaf863a
Jul 08 04:19:56.703130 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.703098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7jlc"]
Jul 08 04:19:56.706163 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:56.706120    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc934de8_65ae_4ed9_85ed_2c25b3dedd5f.slice/crio-4f963a668f5263fff181f2548f4ee6b4cc7bc60fb7eeb69fe32e7e76f3e71ec1 WatchSource:0}: Error finding container 4f963a668f5263fff181f2548f4ee6b4cc7bc60fb7eeb69fe32e7e76f3e71ec1: Status 404 returned error can't find the container with id 4f963a668f5263fff181f2548f4ee6b4cc7bc60fb7eeb69fe32e7e76f3e71ec1
Jul 08 04:19:56.724116 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:56.724085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6sw9w"]
Jul 08 04:19:56.726965 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:19:56.726932    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323ceb42_e486_41f7_b456_ec33939b321f.slice/crio-aee60bfca911f059ab89cc9e5759db7a5d4cb4830c74fffad391d02f7f8b8835 WatchSource:0}: Error finding container aee60bfca911f059ab89cc9e5759db7a5d4cb4830c74fffad391d02f7f8b8835: Status 404 returned error can't find the container with id aee60bfca911f059ab89cc9e5759db7a5d4cb4830c74fffad391d02f7f8b8835
Jul 08 04:19:57.108296 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:57.108258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2dzz" event={"ID":"8f3d653f-60c9-4f73-85d3-d4124b1861ea","Type":"ContainerStarted","Data":"4207dccb94181c8f61aeb707deb26ea7306917d89ec8685660337e63feaf863a"}
Jul 08 04:19:57.109294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:57.109266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sw9w" event={"ID":"323ceb42-e486-41f7-b456-ec33939b321f","Type":"ContainerStarted","Data":"aee60bfca911f059ab89cc9e5759db7a5d4cb4830c74fffad391d02f7f8b8835"}
Jul 08 04:19:57.110251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:57.110232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7jlc" event={"ID":"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f","Type":"ContainerStarted","Data":"4f963a668f5263fff181f2548f4ee6b4cc7bc60fb7eeb69fe32e7e76f3e71ec1"}
Jul 08 04:19:58.115917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.115814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sw9w" event={"ID":"323ceb42-e486-41f7-b456-ec33939b321f","Type":"ContainerStarted","Data":"d9ef75d8fb414cca5114bd6c235f747be340142858d507f3844f7e931f857e90"}
Jul 08 04:19:58.115917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.115889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6sw9w" event={"ID":"323ceb42-e486-41f7-b456-ec33939b321f","Type":"ContainerStarted","Data":"7a1608522f84dc6bfbdf4da045d0600f11c139dc4da16e1ad1236f15a46248b2"}
Jul 08 04:19:58.131890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.130852    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6sw9w" podStartSLOduration=68.033693104 podStartE2EDuration="1m9.130827868s" totalImagesPullingTime="1.097134764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:19:58.130185584 +0000 UTC m=+89.050814088" watchObservedRunningTime="2026-07-08 04:19:58.130827868 +0000 UTC m=+89.051456340"
Jul 08 04:19:58.217000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.216915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:58.270526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.270491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:19:58.323521 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:19:58.323487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:01.345234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:01.345202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:01.445493 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:01.445412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:01.553939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:01.553895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:02.135259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:02.135224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2dzz" event={"ID":"8f3d653f-60c9-4f73-85d3-d4124b1861ea","Type":"ContainerStarted","Data":"3f822039c260817e9e26731b42a13390ec0c7948af09be49cb8d81f3eb8987fc"}
Jul 08 04:20:02.136673 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:02.136655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7jlc" event={"ID":"bc934de8-65ae-4ed9-85ed-2c25b3dedd5f","Type":"ContainerStarted","Data":"2090d138701b5ec676752ec64ec610ee91d2ed506272be1ebcaf38f16a013ea4"}
Jul 08 04:20:02.136785 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:02.136767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:20:02.149633 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:02.149578    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x2dzz" podStartSLOduration=68.710901064 podStartE2EDuration="1m13.149562868s" totalImagesPullingTime="4.438661804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:20:02.148595658 +0000 UTC m=+93.069224120" watchObservedRunningTime="2026-07-08 04:20:02.149562868 +0000 UTC m=+93.070191384"
Jul 08 04:20:02.162874 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:02.162819    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z7jlc" podStartSLOduration=68.753096002 podStartE2EDuration="1m13.162801931s" totalImagesPullingTime="4.409705929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:20:02.161917549 +0000 UTC m=+93.082546031" watchObservedRunningTime="2026-07-08 04:20:02.162801931 +0000 UTC m=+93.083430402"
Jul 08 04:20:24.254163 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:24.254127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:24.750069 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:24.750035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:27.028154 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.028116    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 04:20:27.031674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.031654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.034046 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 04:20:27.034197 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034161    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 04:20:27.034312 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 04:20:27.034312 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034170    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 04:20:27.034398 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 04:20:27.034538 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 04:20:27.034587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 04:20:27.034587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034566    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 04:20:27.034655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.034604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-28jxz\""
Jul 08 04:20:27.039359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.039337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 04:20:27.044776 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.044754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 04:20:27.089976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.089939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-web-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.089976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.089976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2mt\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-kube-api-access-ht2mt\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-volume\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-out\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.090470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.090345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-web-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2mt\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-kube-api-access-ht2mt\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-volume\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-out\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.191947 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.191822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.192744 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.192708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.194513 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194486    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.194774 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.194774 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194690    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0afc9c59-b0cc-4a80-9484-c94cc525ae90-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.194774 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.195014 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-web-config\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.195014 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.194984    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.195119 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.195061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.195489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.195468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.195568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.195495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-volume\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.196301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.196285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0afc9c59-b0cc-4a80-9484-c94cc525ae90-config-out\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.202544 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.202525    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2mt\" (UniqueName: \"kubernetes.io/projected/0afc9c59-b0cc-4a80-9484-c94cc525ae90-kube-api-access-ht2mt\") pod \"alertmanager-main-0\" (UID: \"0afc9c59-b0cc-4a80-9484-c94cc525ae90\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.341906 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.341798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 04:20:27.478001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:27.477431    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 04:20:27.481722 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:20:27.481690    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afc9c59_b0cc_4a80_9484_c94cc525ae90.slice/crio-9551ba9a1b05bf1963ab8358b79b66256e611d9e2bc70a4edae01795aecc9030 WatchSource:0}: Error finding container 9551ba9a1b05bf1963ab8358b79b66256e611d9e2bc70a4edae01795aecc9030: Status 404 returned error can't find the container with id 9551ba9a1b05bf1963ab8358b79b66256e611d9e2bc70a4edae01795aecc9030
Jul 08 04:20:28.223269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:28.223235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"9551ba9a1b05bf1963ab8358b79b66256e611d9e2bc70a4edae01795aecc9030"}
Jul 08 04:20:29.227656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:29.227620    2562 generic.go:356] "Generic (PLEG): container finished" podID="0afc9c59-b0cc-4a80-9484-c94cc525ae90" containerID="856dd939eef9bbac7c770ccd571e9ab42863020aebf5a4b3a98cca3f2884bc3e" exitCode=0
Jul 08 04:20:29.228033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:29.227714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerDied","Data":"856dd939eef9bbac7c770ccd571e9ab42863020aebf5a4b3a98cca3f2884bc3e"}
Jul 08 04:20:32.240516 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:32.240473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"44716cc0cf8e236fbe3ca576042a85ef39992ccd5e99db1e3209292229b696c6"}
Jul 08 04:20:32.240891 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:32.240544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"42765a239c9386a6f7b6f04ddf0d8d20788b89727653dec1c79c5da1158b4e8f"}
Jul 08 04:20:32.240891 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:32.240569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"533204ea4e06eca4ab4513f04c4f50f9853a5b857d8b4109ef32c5563732f8c2"}
Jul 08 04:20:32.240891 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:32.240593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"54d9a892b4db5a92df346af9a7cc0b1b8c0d16cdb95ac7d7f6d34535ae5b3064"}
Jul 08 04:20:32.240891 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:32.240616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"e0f419e46d673e3d86b28b4c2f5bbf1458a3c5d5c30ecf926286b0b48b271dc8"}
Jul 08 04:20:33.144103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:33.144073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z7jlc"
Jul 08 04:20:33.246656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:33.246617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0afc9c59-b0cc-4a80-9484-c94cc525ae90","Type":"ContainerStarted","Data":"d9a24249ae1c373ee6414aa7c260045543e0007dc1bf0226dc7934c0fe684bd2"}
Jul 08 04:20:33.269980 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:33.269925    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.999456141 podStartE2EDuration="6.269905326s" totalImagesPullingTime="4.253688058s" totalInitContainerRuntime="16.761127ms" isStatefulPod=false podCreationTimestamp="2026-07-08 04:20:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:20:33.268842737 +0000 UTC m=+124.189471207" watchObservedRunningTime="2026-07-08 04:20:33.269905326 +0000 UTC m=+124.190533789"
Jul 08 04:20:34.210687 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.210642    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:20:34.212635 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.212620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.215061 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.215040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 04:20:34.215191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.215103    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 04:20:34.215191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.215110    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 04:20:34.216037 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.216015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 04:20:34.216168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.216022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8fwl5\""
Jul 08 04:20:34.216168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.216099    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 04:20:34.216168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.216051    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 04:20:34.216315 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.216232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 04:20:34.220385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.220354    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 04:20:34.221706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.221687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:20:34.268726 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.268699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:34.345653 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.345653 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.345910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966v2\" (UniqueName: \"kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.345910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.345910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.346042 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.345979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.346079 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.346038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.369333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.369296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:34.447374 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447374 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966v2\" (UniqueName: \"kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.447609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.447490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.448204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.448179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.448299 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.448279    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.448343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.448288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.448343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.448290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.450408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.450385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.450495 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.450388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.454829 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.454808    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966v2\" (UniqueName: \"kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2\") pod \"console-66d8f9498b-q2dxz\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") " pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.469000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.468921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:34.522214 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.522179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:34.650724 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:34.650691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:20:34.653547 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:20:34.653522    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda512648d_5a29_4685_8b57_efda3246db82.slice/crio-1d23ffe65b837971af41b65e9a3b8b2786133d6fbb4b22a4e31c9b7f97d4a455 WatchSource:0}: Error finding container 1d23ffe65b837971af41b65e9a3b8b2786133d6fbb4b22a4e31c9b7f97d4a455: Status 404 returned error can't find the container with id 1d23ffe65b837971af41b65e9a3b8b2786133d6fbb4b22a4e31c9b7f97d4a455
Jul 08 04:20:35.006039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:35.006006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:35.060913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:35.060884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:35.254117 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:35.254086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8f9498b-q2dxz" event={"ID":"a512648d-5a29-4685-8b57-efda3246db82","Type":"ContainerStarted","Data":"1d23ffe65b837971af41b65e9a3b8b2786133d6fbb4b22a4e31c9b7f97d4a455"}
Jul 08 04:20:38.266788 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:38.266750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8f9498b-q2dxz" event={"ID":"a512648d-5a29-4685-8b57-efda3246db82","Type":"ContainerStarted","Data":"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"}
Jul 08 04:20:38.284201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:38.284148    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66d8f9498b-q2dxz" podStartSLOduration=0.982741857 podStartE2EDuration="4.284130682s" totalImagesPullingTime="3.301388825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:20:38.28275541 +0000 UTC m=+129.203383882" watchObservedRunningTime="2026-07-08 04:20:38.284130682 +0000 UTC m=+129.204759154"
Jul 08 04:20:44.522494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:44.522444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:44.522494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:44.522513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:44.527193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:44.527167    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:45.294297 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:45.294271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:20:45.437883 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:45.437817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:45.485284 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:45.485239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:45.538000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:45.537974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:45.589944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:45.589836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:20:59.008869 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:20:59.008825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:22.567169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:22.567076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:22.617827 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:22.617780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:39.496691 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:39.496655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:39.562210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:39.562175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:51.395377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:51.395342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:51.445620 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:51.445591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:54.092789 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:54.092758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:54.194964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:54.194927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:56.926872 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:56.926824    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:21:56.928814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:56.928799    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:56.938254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:56.938230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:21:57.012235 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012235 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz56d\" (UniqueName: \"kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.012494 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.012453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.025746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.025709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:21:57.113656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz56d\" (UniqueName: \"kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.113965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.113764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.114489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.114460    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.114607 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.114529    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.114680 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.114660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.114877 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.114834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.116223 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.116200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.116301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.116277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.121662 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.121630    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz56d\" (UniqueName: \"kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d\") pod \"console-5c4d897fd5-r4hgl\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") " pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.237243 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.237211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:21:57.358016 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.357980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:21:57.361163 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:21:57.361126    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c89e44_8e6f_4975_bf38_54156d3e37be.slice/crio-d1b970bd1cd7ca19fe253e3790e44cc56fb031b9893be7ce4bf8bb37ce6beffe WatchSource:0}: Error finding container d1b970bd1cd7ca19fe253e3790e44cc56fb031b9893be7ce4bf8bb37ce6beffe: Status 404 returned error can't find the container with id d1b970bd1cd7ca19fe253e3790e44cc56fb031b9893be7ce4bf8bb37ce6beffe
Jul 08 04:21:57.528588 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.528496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4d897fd5-r4hgl" event={"ID":"e5c89e44-8e6f-4975-bf38-54156d3e37be","Type":"ContainerStarted","Data":"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"}
Jul 08 04:21:57.528588 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.528542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4d897fd5-r4hgl" event={"ID":"e5c89e44-8e6f-4975-bf38-54156d3e37be","Type":"ContainerStarted","Data":"d1b970bd1cd7ca19fe253e3790e44cc56fb031b9893be7ce4bf8bb37ce6beffe"}
Jul 08 04:21:57.544912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:21:57.544838    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c4d897fd5-r4hgl" podStartSLOduration=1.544822614 podStartE2EDuration="1.544822614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:21:57.543912305 +0000 UTC m=+208.464540804" watchObservedRunningTime="2026-07-08 04:21:57.544822614 +0000 UTC m=+208.465451148"
Jul 08 04:22:07.238235 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.238191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:22:07.238623 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.238299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:22:07.242939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.242914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:22:07.565825 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.565746    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:22:07.610338 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.610306    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:22:07.718582 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.718552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:07.773250 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.773218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:07.822196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:07.822119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:32.629939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.629885    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66d8f9498b-q2dxz" podUID="a512648d-5a29-4685-8b57-efda3246db82" containerName="console" containerID="cri-o://707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21" gracePeriod=15
Jul 08 04:22:32.870048 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.870022    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:22:32.977883 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.977827    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.977898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.977923    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.977945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.977963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978005    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-966v2\" (UniqueName: \"kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert\") pod \"a512648d-5a29-4685-8b57-efda3246db82\" (UID: \"a512648d-5a29-4685-8b57-efda3246db82\") "
Jul 08 04:22:32.978467 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978434    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:22:32.978584 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978560    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca" (OuterVolumeSpecName: "service-ca") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:22:32.978641 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978582    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config" (OuterVolumeSpecName: "console-config") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:22:32.978641 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.978564    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:22:32.980393 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.980363    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:22:32.980490 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.980388    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:22:32.980490 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:32.980411    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2" (OuterVolumeSpecName: "kube-api-access-966v2") pod "a512648d-5a29-4685-8b57-efda3246db82" (UID: "a512648d-5a29-4685-8b57-efda3246db82"). InnerVolumeSpecName "kube-api-access-966v2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:22:33.078822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078777    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-oauth-serving-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.078822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078813    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-trusted-ca-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.078822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078823    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.078822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078831    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a512648d-5a29-4685-8b57-efda3246db82-console-config\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.079101 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078839    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-oauth-config\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.079101 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078848    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a512648d-5a29-4685-8b57-efda3246db82-console-serving-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.079101 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.078881    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-966v2\" (UniqueName: \"kubernetes.io/projected/a512648d-5a29-4685-8b57-efda3246db82-kube-api-access-966v2\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:22:33.646427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.646389    2562 generic.go:356] "Generic (PLEG): container finished" podID="a512648d-5a29-4685-8b57-efda3246db82" containerID="707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21" exitCode=0
Jul 08 04:22:33.646427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.646428    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d8f9498b-q2dxz"
Jul 08 04:22:33.646850 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.646479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8f9498b-q2dxz" event={"ID":"a512648d-5a29-4685-8b57-efda3246db82","Type":"ContainerDied","Data":"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"}
Jul 08 04:22:33.646850 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.646519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d8f9498b-q2dxz" event={"ID":"a512648d-5a29-4685-8b57-efda3246db82","Type":"ContainerDied","Data":"1d23ffe65b837971af41b65e9a3b8b2786133d6fbb4b22a4e31c9b7f97d4a455"}
Jul 08 04:22:33.646850 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.646538    2562 scope.go:117] "RemoveContainer" containerID="707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"
Jul 08 04:22:33.654354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.654328    2562 scope.go:117] "RemoveContainer" containerID="707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"
Jul 08 04:22:33.654678 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:22:33.654656    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21\": container with ID starting with 707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21 not found: ID does not exist" containerID="707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"
Jul 08 04:22:33.654761 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.654690    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21"} err="failed to get container status \"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21\": rpc error: code = NotFound desc = could not find container \"707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21\": container with ID starting with 707035324c33a295b0b9568b025f373faa38c3e1025e2c3c5a31f05bb8aa5d21 not found: ID does not exist"
Jul 08 04:22:33.674063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.674026    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:22:33.693332 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.693299    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66d8f9498b-q2dxz"]
Jul 08 04:22:33.726931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:33.726890    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a512648d-5a29-4685-8b57-efda3246db82" path="/var/lib/kubelet/pods/a512648d-5a29-4685-8b57-efda3246db82/volumes"
Jul 08 04:22:48.009468 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:48.009435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:49.807481 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:49.807446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:55.148976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.148898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:55.251678 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.251632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:22:55.728125 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.728098    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"]
Jul 08 04:22:55.728410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.728393    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a512648d-5a29-4685-8b57-efda3246db82" containerName="console"
Jul 08 04:22:55.728487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.728413    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a512648d-5a29-4685-8b57-efda3246db82" containerName="console"
Jul 08 04:22:55.728487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.728470    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a512648d-5a29-4685-8b57-efda3246db82" containerName="console"
Jul 08 04:22:55.730332 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.730313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.732784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.732763    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 04:22:55.732930 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.732782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pczfz\""
Jul 08 04:22:55.733660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.733643    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 04:22:55.740096 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.740073    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"]
Jul 08 04:22:55.836305 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.836267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.836305 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.836305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brkdq\" (UniqueName: \"kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.836518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.836402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.937521 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.937484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.937660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.937536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.937660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.937588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brkdq\" (UniqueName: \"kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.937972 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.937954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.937972 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.937966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:55.945998 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:55.945975    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brkdq\" (UniqueName: \"kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:56.039095 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:56.039008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:22:56.167166 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:56.165087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"]
Jul 08 04:22:56.170037 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:22:56.170009    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5c7953_9853_4192_abb9_e3d8bb29871a.slice/crio-b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68 WatchSource:0}: Error finding container b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68: Status 404 returned error can't find the container with id b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68
Jul 08 04:22:56.728184 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:22:56.728151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc" event={"ID":"ce5c7953-9853-4192-abb9-e3d8bb29871a","Type":"ContainerStarted","Data":"b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68"}
Jul 08 04:23:03.753453 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:03.753415    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerID="6d78c626b62f6d0be646be3ef4df8d053bd2c6720a2b35977ee9b7160a0e4a32" exitCode=0
Jul 08 04:23:03.753923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:03.753504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc" event={"ID":"ce5c7953-9853-4192-abb9-e3d8bb29871a","Type":"ContainerDied","Data":"6d78c626b62f6d0be646be3ef4df8d053bd2c6720a2b35977ee9b7160a0e4a32"}
Jul 08 04:23:06.765974 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:06.765939    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerID="55c1af447a8f9cca01a5b30d365d182511303445c3e2e24157f939249e6c1e52" exitCode=0
Jul 08 04:23:06.766340 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:06.766006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc" event={"ID":"ce5c7953-9853-4192-abb9-e3d8bb29871a","Type":"ContainerDied","Data":"55c1af447a8f9cca01a5b30d365d182511303445c3e2e24157f939249e6c1e52"}
Jul 08 04:23:14.794418 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:14.794386    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerID="12265e0310211deec4cd91ffb030993867f8496605f84b822b5ee0c7d56972b3" exitCode=0
Jul 08 04:23:14.794881 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:14.794425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc" event={"ID":"ce5c7953-9853-4192-abb9-e3d8bb29871a","Type":"ContainerDied","Data":"12265e0310211deec4cd91ffb030993867f8496605f84b822b5ee0c7d56972b3"}
Jul 08 04:23:15.918632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.918604    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:23:15.988656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.988621    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle\") pod \"ce5c7953-9853-4192-abb9-e3d8bb29871a\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") "
Jul 08 04:23:15.988656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.988658    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util\") pod \"ce5c7953-9853-4192-abb9-e3d8bb29871a\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") "
Jul 08 04:23:15.988890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.988678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brkdq\" (UniqueName: \"kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq\") pod \"ce5c7953-9853-4192-abb9-e3d8bb29871a\" (UID: \"ce5c7953-9853-4192-abb9-e3d8bb29871a\") "
Jul 08 04:23:15.989306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.989274    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle" (OuterVolumeSpecName: "bundle") pod "ce5c7953-9853-4192-abb9-e3d8bb29871a" (UID: "ce5c7953-9853-4192-abb9-e3d8bb29871a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:15.990827 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.990807    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq" (OuterVolumeSpecName: "kube-api-access-brkdq") pod "ce5c7953-9853-4192-abb9-e3d8bb29871a" (UID: "ce5c7953-9853-4192-abb9-e3d8bb29871a"). InnerVolumeSpecName "kube-api-access-brkdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:23:15.995587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:15.995458    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util" (OuterVolumeSpecName: "util") pod "ce5c7953-9853-4192-abb9-e3d8bb29871a" (UID: "ce5c7953-9853-4192-abb9-e3d8bb29871a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:16.089219 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.089133    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:16.089219 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.089162    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce5c7953-9853-4192-abb9-e3d8bb29871a-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:16.089219 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.089172    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brkdq\" (UniqueName: \"kubernetes.io/projected/ce5c7953-9853-4192-abb9-e3d8bb29871a-kube-api-access-brkdq\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:16.802745 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.802715    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc"
Jul 08 04:23:16.802933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.802719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754022zmc" event={"ID":"ce5c7953-9853-4192-abb9-e3d8bb29871a","Type":"ContainerDied","Data":"b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68"}
Jul 08 04:23:16.802933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:16.802907    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b861a0944d9dca615921d303c59afdf09cf506007a17cb558be871068e02ce68"
Jul 08 04:23:21.739876 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:21.739837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:22.510727 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:22.510685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:23.628556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"]
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628768    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="pull"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628778    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="pull"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628786    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="extract"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628791    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="extract"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628799    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="util"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628805    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="util"
Jul 08 04:23:23.628964 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.628848    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5c7953-9853-4192-abb9-e3d8bb29871a" containerName="extract"
Jul 08 04:23:23.645849 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.645820    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"]
Jul 08 04:23:23.646028 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.645934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.648456 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.648428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8xtrj\""
Jul 08 04:23:23.648456 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.648456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 04:23:23.648664 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.648562    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 04:23:23.741449 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.741415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6594\" (UniqueName: \"kubernetes.io/projected/6f7a2528-8f7d-4435-9e89-2ddfea299d28-kube-api-access-d6594\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.741449 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.741451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7a2528-8f7d-4435-9e89-2ddfea299d28-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.841993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.841945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6594\" (UniqueName: \"kubernetes.io/projected/6f7a2528-8f7d-4435-9e89-2ddfea299d28-kube-api-access-d6594\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.841993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.841994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7a2528-8f7d-4435-9e89-2ddfea299d28-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.842384 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.842364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f7a2528-8f7d-4435-9e89-2ddfea299d28-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.852840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.852815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6594\" (UniqueName: \"kubernetes.io/projected/6f7a2528-8f7d-4435-9e89-2ddfea299d28-kube-api-access-d6594\") pod \"cert-manager-operator-controller-manager-55c444bf86-9kq6t\" (UID: \"6f7a2528-8f7d-4435-9e89-2ddfea299d28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:23.954941 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:23.954836    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"
Jul 08 04:23:24.105364 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:24.105331    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t"]
Jul 08 04:23:24.108659 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:24.108621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7a2528_8f7d_4435_9e89_2ddfea299d28.slice/crio-44e5487e1b8da6bb285004f38a7279596027c5b5d4a72e30ac849e59a1d12159 WatchSource:0}: Error finding container 44e5487e1b8da6bb285004f38a7279596027c5b5d4a72e30ac849e59a1d12159: Status 404 returned error can't find the container with id 44e5487e1b8da6bb285004f38a7279596027c5b5d4a72e30ac849e59a1d12159
Jul 08 04:23:24.831343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:24.831308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t" event={"ID":"6f7a2528-8f7d-4435-9e89-2ddfea299d28","Type":"ContainerStarted","Data":"44e5487e1b8da6bb285004f38a7279596027c5b5d4a72e30ac849e59a1d12159"}
Jul 08 04:23:25.347840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:25.347803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:25.399455 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:25.399414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:26.841049 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:26.841014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t" event={"ID":"6f7a2528-8f7d-4435-9e89-2ddfea299d28","Type":"ContainerStarted","Data":"affba7bb4c9f93121a93c4fc27440234290dfc7fb05d4d5e1783a8372ced7b47"}
Jul 08 04:23:26.863309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:26.863247    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9kq6t" podStartSLOduration=1.340662953 podStartE2EDuration="3.863223545s" totalImagesPullingTime="2.522560592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:23:26.862019574 +0000 UTC m=+297.782648045" watchObservedRunningTime="2026-07-08 04:23:26.863223545 +0000 UTC m=+297.783852019"
Jul 08 04:23:27.246916 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.246886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:27.346905 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.346872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:27.534682 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.534599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:27.549087 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.549051    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"]
Jul 08 04:23:27.553070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.553042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.555700 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.555679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 04:23:27.556077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.556059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pczfz\""
Jul 08 04:23:27.556687 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.556671    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 04:23:27.566069 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.566046    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"]
Jul 08 04:23:27.569755 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.569728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjwm\" (UniqueName: \"kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.569910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.569872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.569973 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.569923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.627824 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.627782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:27.670885 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.670823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.670885 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.670882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.671102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.670905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjwm\" (UniqueName: \"kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.671221 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.671204    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.671292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.671274    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.684254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.684220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjwm\" (UniqueName: \"kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.861640 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.861563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:27.895201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.895171    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bjgwz"]
Jul 08 04:23:27.898238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.897527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:27.900847 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.900822    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 04:23:27.901001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.900896    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r77xz\""
Jul 08 04:23:27.901187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.901172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 04:23:27.923777 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.923725    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bjgwz"]
Jul 08 04:23:27.973676 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.973644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:27.973871 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.973788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwg8\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-kube-api-access-fvwg8\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:27.993574 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:27.993487    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"]
Jul 08 04:23:27.995985 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:27.995958    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629d0309_0ae8_4434_af9c_4cba8fbdb460.slice/crio-2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334 WatchSource:0}: Error finding container 2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334: Status 404 returned error can't find the container with id 2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334
Jul 08 04:23:28.074599 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.074553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwg8\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-kube-api-access-fvwg8\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:28.074768 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.074640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:28.082822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.082796    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:28.082990 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.082967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwg8\" (UniqueName: \"kubernetes.io/projected/512c04b4-4598-457b-9365-3d75691f74fa-kube-api-access-fvwg8\") pod \"cert-manager-webhook-6486ffd997-bjgwz\" (UID: \"512c04b4-4598-457b-9365-3d75691f74fa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:28.221093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.221006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:28.346113 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.346080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-bjgwz"]
Jul 08 04:23:28.349138 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:28.349115    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod512c04b4_4598_457b_9365_3d75691f74fa.slice/crio-741b05846eb4052961a560fdf1984f7c4d33421c0390faeaa255e2118069a772 WatchSource:0}: Error finding container 741b05846eb4052961a560fdf1984f7c4d33421c0390faeaa255e2118069a772: Status 404 returned error can't find the container with id 741b05846eb4052961a560fdf1984f7c4d33421c0390faeaa255e2118069a772
Jul 08 04:23:28.849583 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.849544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz" event={"ID":"512c04b4-4598-457b-9365-3d75691f74fa","Type":"ContainerStarted","Data":"741b05846eb4052961a560fdf1984f7c4d33421c0390faeaa255e2118069a772"}
Jul 08 04:23:28.850758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.850737    2562 generic.go:356] "Generic (PLEG): container finished" podID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerID="54ceb620a590ce80cc2cee806346a692fb7f1258194a6f4e6058cf8d02ee7624" exitCode=0
Jul 08 04:23:28.850853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.850769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b" event={"ID":"629d0309-0ae8-4434-af9c-4cba8fbdb460","Type":"ContainerDied","Data":"54ceb620a590ce80cc2cee806346a692fb7f1258194a6f4e6058cf8d02ee7624"}
Jul 08 04:23:28.850853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:28.850797    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b" event={"ID":"629d0309-0ae8-4434-af9c-4cba8fbdb460","Type":"ContainerStarted","Data":"2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334"}
Jul 08 04:23:29.503349 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:29.503325    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:23:29.503725 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:29.503407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:23:29.505602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:29.505585    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 04:23:29.901485 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:29.901407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:30.110274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:30.110223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:32.141071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.140985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:32.195730 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.195688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:32.870601 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.870569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz" event={"ID":"512c04b4-4598-457b-9365-3d75691f74fa","Type":"ContainerStarted","Data":"c27494bd15672779803edc072939a2770418d801621221e9e3a4165b3bdcdbaf"}
Jul 08 04:23:32.870788 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.870690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:32.872432 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.872408    2562 generic.go:356] "Generic (PLEG): container finished" podID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerID="74c8251a556cb5c88d4ca8234e0a64b60aff1a96b55a243388ff6aa6e098b06a" exitCode=0
Jul 08 04:23:32.872545 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.872490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b" event={"ID":"629d0309-0ae8-4434-af9c-4cba8fbdb460","Type":"ContainerDied","Data":"74c8251a556cb5c88d4ca8234e0a64b60aff1a96b55a243388ff6aa6e098b06a"}
Jul 08 04:23:32.886537 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:32.886481    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz" podStartSLOduration=2.409042986 podStartE2EDuration="5.886463107s" totalImagesPullingTime="3.477420121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:23:32.886265903 +0000 UTC m=+303.806894400" watchObservedRunningTime="2026-07-08 04:23:32.886463107 +0000 UTC m=+303.807091579"
Jul 08 04:23:33.878559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:33.878523    2562 generic.go:356] "Generic (PLEG): container finished" podID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerID="2f17dae4751a610e8d44791b26ee0811396b7baf24b35125205542db34cb507a" exitCode=0
Jul 08 04:23:33.879080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:33.878616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b" event={"ID":"629d0309-0ae8-4434-af9c-4cba8fbdb460","Type":"ContainerDied","Data":"2f17dae4751a610e8d44791b26ee0811396b7baf24b35125205542db34cb507a"}
Jul 08 04:23:34.269377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.269343    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"]
Jul 08 04:23:34.271358 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.271341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.273637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.273617    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cgxfh\""
Jul 08 04:23:34.279215 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.279194    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"]
Jul 08 04:23:34.321667 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.321628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfb2k\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-kube-api-access-xfb2k\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.321835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.321679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.422233 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.422194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfb2k\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-kube-api-access-xfb2k\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.422396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.422246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.430044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.430020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.430207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.430187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfb2k\" (UniqueName: \"kubernetes.io/projected/674a8076-c759-43da-a44c-d1f6fcefd54c-kube-api-access-xfb2k\") pod \"cert-manager-cainjector-559cdd8c87-dkl8p\" (UID: \"674a8076-c759-43da-a44c-d1f6fcefd54c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.580007 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.579920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"
Jul 08 04:23:34.709692 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.709658    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p"]
Jul 08 04:23:34.712315 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:34.712292    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod674a8076_c759_43da_a44c_d1f6fcefd54c.slice/crio-d6e61393f46087fb225b420875d8a7c4335a4165d554ea281b6bbc89ee92a82f WatchSource:0}: Error finding container d6e61393f46087fb225b420875d8a7c4335a4165d554ea281b6bbc89ee92a82f: Status 404 returned error can't find the container with id d6e61393f46087fb225b420875d8a7c4335a4165d554ea281b6bbc89ee92a82f
Jul 08 04:23:34.884301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.884194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p" event={"ID":"674a8076-c759-43da-a44c-d1f6fcefd54c","Type":"ContainerStarted","Data":"5a2f3b0a3bdfcb69938aa3c84d7a1d2816c4038d075264ed8599d4fa1fdd14ca"}
Jul 08 04:23:34.884301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.884243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p" event={"ID":"674a8076-c759-43da-a44c-d1f6fcefd54c","Type":"ContainerStarted","Data":"d6e61393f46087fb225b420875d8a7c4335a4165d554ea281b6bbc89ee92a82f"}
Jul 08 04:23:34.901191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:34.901131    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dkl8p" podStartSLOduration=0.901107704 podStartE2EDuration="901.107704ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:23:34.900331103 +0000 UTC m=+305.820959580" watchObservedRunningTime="2026-07-08 04:23:34.901107704 +0000 UTC m=+305.821736178"
Jul 08 04:23:35.009319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.009287    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:35.128598 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.128561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjwm\" (UniqueName: \"kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm\") pod \"629d0309-0ae8-4434-af9c-4cba8fbdb460\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") "
Jul 08 04:23:35.128783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.128628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle\") pod \"629d0309-0ae8-4434-af9c-4cba8fbdb460\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") "
Jul 08 04:23:35.128783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.128684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util\") pod \"629d0309-0ae8-4434-af9c-4cba8fbdb460\" (UID: \"629d0309-0ae8-4434-af9c-4cba8fbdb460\") "
Jul 08 04:23:35.129156 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.129119    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle" (OuterVolumeSpecName: "bundle") pod "629d0309-0ae8-4434-af9c-4cba8fbdb460" (UID: "629d0309-0ae8-4434-af9c-4cba8fbdb460"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:35.130679 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.130655    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm" (OuterVolumeSpecName: "kube-api-access-lzjwm") pod "629d0309-0ae8-4434-af9c-4cba8fbdb460" (UID: "629d0309-0ae8-4434-af9c-4cba8fbdb460"). InnerVolumeSpecName "kube-api-access-lzjwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:23:35.133003 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.132982    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util" (OuterVolumeSpecName: "util") pod "629d0309-0ae8-4434-af9c-4cba8fbdb460" (UID: "629d0309-0ae8-4434-af9c-4cba8fbdb460"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:35.230114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.230077    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:35.230114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.230107    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629d0309-0ae8-4434-af9c-4cba8fbdb460-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:35.230114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.230119    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjwm\" (UniqueName: \"kubernetes.io/projected/629d0309-0ae8-4434-af9c-4cba8fbdb460-kube-api-access-lzjwm\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:35.483230 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.483148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:35.584089 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.584057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:35.890389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.890359    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b"
Jul 08 04:23:35.890770 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.890389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6754b" event={"ID":"629d0309-0ae8-4434-af9c-4cba8fbdb460","Type":"ContainerDied","Data":"2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334"}
Jul 08 04:23:35.890770 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:35.890439    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2adc4875b3702dea744b3619848a71ec8012e5bdbbaf32aac64968ee3c5fb334"
Jul 08 04:23:37.304124 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.304087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:37.918943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.918905    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8mrgz"]
Jul 08 04:23:37.919183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919170    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="extract"
Jul 08 04:23:37.919222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919185    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="extract"
Jul 08 04:23:37.919222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919206    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="util"
Jul 08 04:23:37.919222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919212    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="util"
Jul 08 04:23:37.919222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919219    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="pull"
Jul 08 04:23:37.919372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919224    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="pull"
Jul 08 04:23:37.919372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.919264    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="629d0309-0ae8-4434-af9c-4cba8fbdb460" containerName="extract"
Jul 08 04:23:37.921090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.921075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:37.923392 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.923373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hzrb5\""
Jul 08 04:23:37.931363 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.931340    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8mrgz"]
Jul 08 04:23:37.949819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.949780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:37.949819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:37.949819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769k9\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-kube-api-access-769k9\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.050283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.050238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.050283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.050283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769k9\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-kube-api-access-769k9\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.058511 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.058483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.058613 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.058598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769k9\" (UniqueName: \"kubernetes.io/projected/f6c75427-c983-4f45-8836-3ee84e50a39b-kube-api-access-769k9\") pod \"cert-manager-55b4d954d5-8mrgz\" (UID: \"f6c75427-c983-4f45-8836-3ee84e50a39b\") " pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.229710 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.229675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8mrgz"
Jul 08 04:23:38.354846 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.354816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8mrgz"]
Jul 08 04:23:38.357526 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:38.357493    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6c75427_c983_4f45_8836_3ee84e50a39b.slice/crio-bfb49d079bd81edac5c4d61e5aae0107ecac21154a435f9997c4c3f0749700e2 WatchSource:0}: Error finding container bfb49d079bd81edac5c4d61e5aae0107ecac21154a435f9997c4c3f0749700e2: Status 404 returned error can't find the container with id bfb49d079bd81edac5c4d61e5aae0107ecac21154a435f9997c4c3f0749700e2
Jul 08 04:23:38.881188 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.881159    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-bjgwz"
Jul 08 04:23:38.903259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.903225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8mrgz" event={"ID":"f6c75427-c983-4f45-8836-3ee84e50a39b","Type":"ContainerStarted","Data":"94df651b3a9b451bdf7122f92bca84abaee8f90d332243c182fc417c2a92e532"}
Jul 08 04:23:38.903259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.903265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8mrgz" event={"ID":"f6c75427-c983-4f45-8836-3ee84e50a39b","Type":"ContainerStarted","Data":"bfb49d079bd81edac5c4d61e5aae0107ecac21154a435f9997c4c3f0749700e2"}
Jul 08 04:23:38.919487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:38.919441    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8mrgz" podStartSLOduration=1.919425669 podStartE2EDuration="1.919425669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:23:38.918049549 +0000 UTC m=+309.838678023" watchObservedRunningTime="2026-07-08 04:23:38.919425669 +0000 UTC m=+309.840054141"
Jul 08 04:23:40.429646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:40.429608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:40.529267 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:40.529227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:45.870150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:45.870117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:45.973927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:45.973896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:47.262408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.262376    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"]
Jul 08 04:23:47.269201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.269165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.272470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.272439    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 04:23:47.273079 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.273055    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 04:23:47.273208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.273060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pczfz\""
Jul 08 04:23:47.273791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.273766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"]
Jul 08 04:23:47.314561 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.314520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.314746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.314593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.314746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.314626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4zwr\" (UniqueName: \"kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.415617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.415593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.415765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.415641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.415765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.415666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4zwr\" (UniqueName: \"kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.416031 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.416014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.416080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.416062    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.424100 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.424067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4zwr\" (UniqueName: \"kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.580018 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.579930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:47.706021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.705909    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"]
Jul 08 04:23:47.709121 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:23:47.709094    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cabef61_4958_41a7_823b_3603aec8212a.slice/crio-e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c WatchSource:0}: Error finding container e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c: Status 404 returned error can't find the container with id e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c
Jul 08 04:23:47.941442 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.941347    2562 generic.go:356] "Generic (PLEG): container finished" podID="7cabef61-4958-41a7-823b-3603aec8212a" containerID="76cec11cc6a6f1b9dfb63f29c12aa0ec1b481a6aad18ab3062ffec1325703f5e" exitCode=0
Jul 08 04:23:47.941586 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.941437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd" event={"ID":"7cabef61-4958-41a7-823b-3603aec8212a","Type":"ContainerDied","Data":"76cec11cc6a6f1b9dfb63f29c12aa0ec1b481a6aad18ab3062ffec1325703f5e"}
Jul 08 04:23:47.941586 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.941492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd" event={"ID":"7cabef61-4958-41a7-823b-3603aec8212a","Type":"ContainerStarted","Data":"e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c"}
Jul 08 04:23:47.941920 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:47.941907    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:23:48.006068 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:48.006039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:23:48.948276 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:48.948187    2562 generic.go:356] "Generic (PLEG): container finished" podID="7cabef61-4958-41a7-823b-3603aec8212a" containerID="cc6cccc1b1c4461e26b4c3144fde773d63e2c4d8d94a361032b0168fd3c285c5" exitCode=0
Jul 08 04:23:48.948276 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:48.948230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd" event={"ID":"7cabef61-4958-41a7-823b-3603aec8212a","Type":"ContainerDied","Data":"cc6cccc1b1c4461e26b4c3144fde773d63e2c4d8d94a361032b0168fd3c285c5"}
Jul 08 04:23:49.954654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:49.954620    2562 generic.go:356] "Generic (PLEG): container finished" podID="7cabef61-4958-41a7-823b-3603aec8212a" containerID="5a728b2346bd4a06afd85fabf5e8dae3b9bd849d3c406a0a97f211ed3808158f" exitCode=0
Jul 08 04:23:49.955047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:49.954666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd" event={"ID":"7cabef61-4958-41a7-823b-3603aec8212a","Type":"ContainerDied","Data":"5a728b2346bd4a06afd85fabf5e8dae3b9bd849d3c406a0a97f211ed3808158f"}
Jul 08 04:23:51.083243 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.083217    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:23:51.146853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.146817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4zwr\" (UniqueName: \"kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr\") pod \"7cabef61-4958-41a7-823b-3603aec8212a\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") "
Jul 08 04:23:51.146853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.146879    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util\") pod \"7cabef61-4958-41a7-823b-3603aec8212a\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") "
Jul 08 04:23:51.147133 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.146922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle\") pod \"7cabef61-4958-41a7-823b-3603aec8212a\" (UID: \"7cabef61-4958-41a7-823b-3603aec8212a\") "
Jul 08 04:23:51.147605 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.147579    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle" (OuterVolumeSpecName: "bundle") pod "7cabef61-4958-41a7-823b-3603aec8212a" (UID: "7cabef61-4958-41a7-823b-3603aec8212a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:51.148906 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.148881    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr" (OuterVolumeSpecName: "kube-api-access-x4zwr") pod "7cabef61-4958-41a7-823b-3603aec8212a" (UID: "7cabef61-4958-41a7-823b-3603aec8212a"). InnerVolumeSpecName "kube-api-access-x4zwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:23:51.152705 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.152682    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util" (OuterVolumeSpecName: "util") pod "7cabef61-4958-41a7-823b-3603aec8212a" (UID: "7cabef61-4958-41a7-823b-3603aec8212a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:23:51.248410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.248368    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:51.248410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.248405    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4zwr\" (UniqueName: \"kubernetes.io/projected/7cabef61-4958-41a7-823b-3603aec8212a-kube-api-access-x4zwr\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:51.248410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.248418    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cabef61-4958-41a7-823b-3603aec8212a-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:23:51.965137 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.965106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd" event={"ID":"7cabef61-4958-41a7-823b-3603aec8212a","Type":"ContainerDied","Data":"e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c"}
Jul 08 04:23:51.965301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.965148    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5329a95260684ae83934f56e18fe731957d28bc805546d44dd6207ace7b5a1c"
Jul 08 04:23:51.965301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:23:51.965152    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvf8xd"
Jul 08 04:24:00.650851 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:00.650815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:00.728709 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:00.728678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.203040 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.202998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.424183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.424156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.530554 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.530528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.578680 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578646    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"]
Jul 08 04:24:01.578924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578912    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="extract"
Jul 08 04:24:01.578981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578926    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="extract"
Jul 08 04:24:01.578981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578944    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="util"
Jul 08 04:24:01.578981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578949    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="util"
Jul 08 04:24:01.578981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578956    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="pull"
Jul 08 04:24:01.578981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.578962    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="pull"
Jul 08 04:24:01.579140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.579001    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cabef61-4958-41a7-823b-3603aec8212a" containerName="extract"
Jul 08 04:24:01.584923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.584902    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.587696 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.587676    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qrljm\""
Jul 08 04:24:01.588059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.588043    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 04:24:01.588154 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.588082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 04:24:01.588154 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.588101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 04:24:01.588346 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.588331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 04:24:01.600845 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.600818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"]
Jul 08 04:24:01.724157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.724122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-manifests\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.724157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.724157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.724643 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.724176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-tmp\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.724643 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.724310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql7th\" (UniqueName: \"kubernetes.io/projected/d158b6ec-9010-493d-8493-f083e5ccdb01-kube-api-access-ql7th\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.724643 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.724356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.752642 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.752585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.824840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.824744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql7th\" (UniqueName: \"kubernetes.io/projected/d158b6ec-9010-493d-8493-f083e5ccdb01-kube-api-access-ql7th\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.824840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.824785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.824840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.824828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-manifests\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.825142 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.824846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.825142 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.824886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-tmp\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.825313 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.825287    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-manifests\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.827164 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.827144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d158b6ec-9010-493d-8493-f083e5ccdb01-tmp\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.827514 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.827492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.827554 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.827498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d158b6ec-9010-493d-8493-f083e5ccdb01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.833142 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.833118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql7th\" (UniqueName: \"kubernetes.io/projected/d158b6ec-9010-493d-8493-f083e5ccdb01-kube-api-access-ql7th\") pod \"opendatahub-operator-controller-manager-7f76f945bd-5wx2r\" (UID: \"d158b6ec-9010-493d-8493-f083e5ccdb01\") " pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.854086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.854055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:01.895036 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.895003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:01.959561 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:01.959523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:02.051087 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:02.048551    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"]
Jul 08 04:24:02.054691 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:24:02.054572    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd158b6ec_9010_493d_8493_f083e5ccdb01.slice/crio-fb2a7662e0b3d6d11dffb3f7b7593ad33fb31cd2b16d89199c5d0fa5d40e4370 WatchSource:0}: Error finding container fb2a7662e0b3d6d11dffb3f7b7593ad33fb31cd2b16d89199c5d0fa5d40e4370: Status 404 returned error can't find the container with id fb2a7662e0b3d6d11dffb3f7b7593ad33fb31cd2b16d89199c5d0fa5d40e4370
Jul 08 04:24:02.054871 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:02.054712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:02.135379 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:02.135301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:02.246965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:02.246934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:03.011915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:03.011877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r" event={"ID":"d158b6ec-9010-493d-8493-f083e5ccdb01","Type":"ContainerStarted","Data":"fb2a7662e0b3d6d11dffb3f7b7593ad33fb31cd2b16d89199c5d0fa5d40e4370"}
Jul 08 04:24:06.027997 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:06.027963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r" event={"ID":"d158b6ec-9010-493d-8493-f083e5ccdb01","Type":"ContainerStarted","Data":"f7f13f21652038a59303835b1fda9c661a0c8121901bfe332595daa5bcbee9df"}
Jul 08 04:24:07.033834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:07.033800    2562 generic.go:356] "Generic (PLEG): container finished" podID="d158b6ec-9010-493d-8493-f083e5ccdb01" containerID="f7f13f21652038a59303835b1fda9c661a0c8121901bfe332595daa5bcbee9df" exitCode=0
Jul 08 04:24:07.034235 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:07.033894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r" event={"ID":"d158b6ec-9010-493d-8493-f083e5ccdb01","Type":"ContainerDied","Data":"f7f13f21652038a59303835b1fda9c661a0c8121901bfe332595daa5bcbee9df"}
Jul 08 04:24:08.040448 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:08.040409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r" event={"ID":"d158b6ec-9010-493d-8493-f083e5ccdb01","Type":"ContainerStarted","Data":"76606f746c880b2cb1a03091760674b564730823bcb248c0aa9e82af184c311e"}
Jul 08 04:24:08.040909 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:08.040538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:08.061935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:08.061802    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r" podStartSLOduration=2.679680606 podStartE2EDuration="7.061782356s" totalImagesPullingTime="3.341298767s" totalInitContainerRuntime="1.040802983s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:24:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:24:08.06010425 +0000 UTC m=+338.980732767" watchObservedRunningTime="2026-07-08 04:24:08.061782356 +0000 UTC m=+338.982410831"
Jul 08 04:24:10.215131 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:10.215101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:10.321748 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:10.321713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:19.046950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:19.046921    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f76f945bd-5wx2r"
Jul 08 04:24:21.003706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.003633    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"]
Jul 08 04:24:21.008800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.008776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.012721 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.012698    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 04:24:21.013455 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.013436    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 04:24:21.013703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.013685    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8xv6x\""
Jul 08 04:24:21.013812 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.013735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 04:24:21.013812 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.013763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 04:24:21.013953 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.013836    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 04:24:21.032205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.032176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"]
Jul 08 04:24:21.035203 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.035179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:21.179360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.179328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4576e945-504a-4afd-b93e-38f93bc4235a-manager-config\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.179360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.179364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxhn\" (UniqueName: \"kubernetes.io/projected/4576e945-504a-4afd-b93e-38f93bc4235a-kube-api-access-qpxhn\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.179591 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.179431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.179591 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.179490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-metrics-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.220846 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.220811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:21.280749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.280657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4576e945-504a-4afd-b93e-38f93bc4235a-manager-config\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.280749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.280700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxhn\" (UniqueName: \"kubernetes.io/projected/4576e945-504a-4afd-b93e-38f93bc4235a-kube-api-access-qpxhn\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.280749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.280747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.281073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.280782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-metrics-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.281457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.281436    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4576e945-504a-4afd-b93e-38f93bc4235a-manager-config\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.283248 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.283229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.283355 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.283271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4576e945-504a-4afd-b93e-38f93bc4235a-metrics-cert\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.300756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.300716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxhn\" (UniqueName: \"kubernetes.io/projected/4576e945-504a-4afd-b93e-38f93bc4235a-kube-api-access-qpxhn\") pod \"lws-controller-manager-75c8b6477f-9sthc\" (UID: \"4576e945-504a-4afd-b93e-38f93bc4235a\") " pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.317593 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.317559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:21.450490 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.449015    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"]
Jul 08 04:24:21.454238 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:24:21.454211    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4576e945_504a_4afd_b93e_38f93bc4235a.slice/crio-f10e7fd46067ff9596a8939d7ce53cb124bdece77e7c2bb901978e2e99dd6238 WatchSource:0}: Error finding container f10e7fd46067ff9596a8939d7ce53cb124bdece77e7c2bb901978e2e99dd6238: Status 404 returned error can't find the container with id f10e7fd46067ff9596a8939d7ce53cb124bdece77e7c2bb901978e2e99dd6238
Jul 08 04:24:21.793560 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.793528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:21.888172 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.888143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:21.988489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:21.988460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:22.098219 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:22.098124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc" event={"ID":"4576e945-504a-4afd-b93e-38f93bc4235a","Type":"ContainerStarted","Data":"f10e7fd46067ff9596a8939d7ce53cb124bdece77e7c2bb901978e2e99dd6238"}
Jul 08 04:24:22.378310 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:22.378232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:22.478684 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:22.478654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:26.115783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:26.115754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc" event={"ID":"4576e945-504a-4afd-b93e-38f93bc4235a","Type":"ContainerStarted","Data":"b7225707778f371f34ab3d160c61d3ec8977ecc5f03fe78e1b74f98a8d7a2d4c"}
Jul 08 04:24:26.116183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:26.115821    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:26.135994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:26.135942    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc" podStartSLOduration=2.5207576080000003 podStartE2EDuration="6.135925689s" totalImagesPullingTime="3.615168081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:24:26.134241538 +0000 UTC m=+357.054870028" watchObservedRunningTime="2026-07-08 04:24:26.135925689 +0000 UTC m=+357.056554160"
Jul 08 04:24:27.022521 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:27.022487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:27.165070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:27.165042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:28.200691 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.200655    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:28.202704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.202689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.205283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.205259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 04:24:28.205414 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.205326    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 04:24:28.206021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.206001    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 04:24:28.206115 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.206043    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xsdpj\""
Jul 08 04:24:28.206280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.206264    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 04:24:28.206362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.206348    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 04:24:28.206414 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.206353    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 04:24:28.208427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.208408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:28.222688 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.222659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:28.305551 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.305523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:28.339766 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.339725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.339766 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.339768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.339995 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.339838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.339995 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.339958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.339995 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.339985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.340110 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.340013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.340110 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.340041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjczq\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.440950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.440908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.440950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.440955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjczq\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.440990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.441014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.441061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.441131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.441156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.441739 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.441703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.443520 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.443490    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.443611 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.443540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.443611 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.443557    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.443684 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.443663    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.455848 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.455788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.455951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.455882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjczq\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq\") pod \"istiod-openshift-gateway-7574459656-6zffl\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.511920 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.511851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:28.654825 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:28.654792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:28.657782 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:24:28.657762    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode049c064_d1bd_45cf_8515_d062bc68386f.slice/crio-e4b71bf2bc0c22bcb4c76289df085fceb6b23b8f3a5c8af6046957e56909773e WatchSource:0}: Error finding container e4b71bf2bc0c22bcb4c76289df085fceb6b23b8f3a5c8af6046957e56909773e: Status 404 returned error can't find the container with id e4b71bf2bc0c22bcb4c76289df085fceb6b23b8f3a5c8af6046957e56909773e
Jul 08 04:24:29.133592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:29.133507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" event={"ID":"e049c064-d1bd-45cf-8515-d062bc68386f","Type":"ContainerStarted","Data":"e4b71bf2bc0c22bcb4c76289df085fceb6b23b8f3a5c8af6046957e56909773e"}
Jul 08 04:24:29.762359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:29.762320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:31.536085 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:31.536042    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:24:31.536338 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:31.536127    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:24:32.150158 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.150119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" event={"ID":"e049c064-d1bd-45cf-8515-d062bc68386f","Type":"ContainerStarted","Data":"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"}
Jul 08 04:24:32.150364 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.150283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:32.151926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.151897    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-6zffl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 04:24:32.152019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.151951    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 04:24:32.183657 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.183629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:32.202112 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.202058    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" podStartSLOduration=1.325850322 podStartE2EDuration="4.202040152s" totalImagesPullingTime="2.87618983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:24:32.193772932 +0000 UTC m=+363.114401430" watchObservedRunningTime="2026-07-08 04:24:32.202040152 +0000 UTC m=+363.122668624"
Jul 08 04:24:32.330143 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.330106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:32.423824 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.423744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:32.464706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.464672    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"]
Jul 08 04:24:32.467443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.467424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.470081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.470060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 04:24:32.470214 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.470155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vsn9w\""
Jul 08 04:24:32.477539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.477515    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"]
Jul 08 04:24:32.499189 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.499151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:32.577263 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.577218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.577654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.577272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qk5n\" (UniqueName: \"kubernetes.io/projected/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-kube-api-access-5qk5n\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.678655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.678565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.678655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.678618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qk5n\" (UniqueName: \"kubernetes.io/projected/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-kube-api-access-5qk5n\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.678853 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:24:32.678721    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 04:24:32.678853 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:24:32.678792    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert podName:a9cfd22d-e7e0-42f6-b954-0db8c87bb2de nodeName:}" failed. No retries permitted until 2026-07-08 04:24:33.178772363 +0000 UTC m=+364.099400817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert") pod "llmisvc-controller-manager-777c6bd7d5-h2c8g" (UID: "a9cfd22d-e7e0-42f6-b954-0db8c87bb2de") : secret "llmisvc-webhook-server-cert" not found
Jul 08 04:24:32.688917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.688882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qk5n\" (UniqueName: \"kubernetes.io/projected/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-kube-api-access-5qk5n\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:32.967139 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:32.967031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.065233 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.065196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.155399 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.155373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:33.162799 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.162774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.182811 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.182774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:33.185176 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.185143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9cfd22d-e7e0-42f6-b954-0db8c87bb2de-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h2c8g\" (UID: \"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:33.263467 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.263439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.378293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.378257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:33.393125 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.393075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.526472 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.526368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"]
Jul 08 04:24:33.529357 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:24:33.529329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9cfd22d_e7e0_42f6_b954_0db8c87bb2de.slice/crio-868962e98924752021de1a9c672efc28f61c3e47df3ee59c4e57898a3c0f3c08 WatchSource:0}: Error finding container 868962e98924752021de1a9c672efc28f61c3e47df3ee59c4e57898a3c0f3c08: Status 404 returned error can't find the container with id 868962e98924752021de1a9c672efc28f61c3e47df3ee59c4e57898a3c0f3c08
Jul 08 04:24:33.777078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.776979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:33.893582 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:33.893551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:34.081758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:34.081629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:24:34.159598 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:34.159563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g" event={"ID":"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de","Type":"ContainerStarted","Data":"868962e98924752021de1a9c672efc28f61c3e47df3ee59c4e57898a3c0f3c08"}
Jul 08 04:24:34.977536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:34.977501    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:35.164607 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.164566    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" containerName="discovery" containerID="cri-o://f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc" gracePeriod=30
Jul 08 04:24:35.409240 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.409216    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:35.500923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.500881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.500933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjczq\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.500965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.501002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.501042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.501067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501338 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.501093    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig\") pod \"e049c064-d1bd-45cf-8515-d062bc68386f\" (UID: \"e049c064-d1bd-45cf-8515-d062bc68386f\") "
Jul 08 04:24:35.501498 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.501466    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:24:35.503401 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503370    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs" (OuterVolumeSpecName: "local-certs") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:24:35.503401 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503384    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:24:35.503565 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503547    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts" (OuterVolumeSpecName: "cacerts") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:24:35.503623 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503592    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:24:35.503660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503627    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq" (OuterVolumeSpecName: "kube-api-access-qjczq") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "kube-api-access-qjczq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:24:35.503731 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.503710    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e049c064-d1bd-45cf-8515-d062bc68386f" (UID: "e049c064-d1bd-45cf-8515-d062bc68386f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601625    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-ca-configmap\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601660    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601671    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-csr-dns-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601681    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-istio-kubeconfig\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601690    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e049c064-d1bd-45cf-8515-d062bc68386f-cacerts\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601700    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjczq\" (UniqueName: \"kubernetes.io/projected/e049c064-d1bd-45cf-8515-d062bc68386f-kube-api-access-qjczq\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:35.601712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:35.601708    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e049c064-d1bd-45cf-8515-d062bc68386f-local-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:24:36.170677 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.170643    2562 generic.go:356] "Generic (PLEG): container finished" podID="e049c064-d1bd-45cf-8515-d062bc68386f" containerID="f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc" exitCode=0
Jul 08 04:24:36.171149 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.170690    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"
Jul 08 04:24:36.171149 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.170695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" event={"ID":"e049c064-d1bd-45cf-8515-d062bc68386f","Type":"ContainerDied","Data":"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"}
Jul 08 04:24:36.171149 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.170747    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-6zffl" event={"ID":"e049c064-d1bd-45cf-8515-d062bc68386f","Type":"ContainerDied","Data":"e4b71bf2bc0c22bcb4c76289df085fceb6b23b8f3a5c8af6046957e56909773e"}
Jul 08 04:24:36.171149 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.170768    2562 scope.go:117] "RemoveContainer" containerID="f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"
Jul 08 04:24:36.211696 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.211663    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:36.222051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.222023    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-6zffl"]
Jul 08 04:24:36.609993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.609942    2562 scope.go:117] "RemoveContainer" containerID="f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"
Jul 08 04:24:36.610273 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:24:36.610254    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc\": container with ID starting with f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc not found: ID does not exist" containerID="f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"
Jul 08 04:24:36.610322 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:36.610281    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc"} err="failed to get container status \"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc\": rpc error: code = NotFound desc = could not find container \"f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc\": container with ID starting with f1419e719f2ecde5e52de4276f868e30328692544592ca085915718cdc152bbc not found: ID does not exist"
Jul 08 04:24:37.122130 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:37.122103    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75c8b6477f-9sthc"
Jul 08 04:24:37.178045 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:37.178012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g" event={"ID":"a9cfd22d-e7e0-42f6-b954-0db8c87bb2de","Type":"ContainerStarted","Data":"4bafee12000d39e4794cfababbd76fe7f8d4912be94b768f23ed36d48a354928"}
Jul 08 04:24:37.178503 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:37.178137    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:24:37.194708 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:37.194654    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g" podStartSLOduration=1.763122498 podStartE2EDuration="5.194638596s" totalImagesPullingTime="3.431516098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:24:37.193878158 +0000 UTC m=+368.114506644" watchObservedRunningTime="2026-07-08 04:24:37.194638596 +0000 UTC m=+368.115267069"
Jul 08 04:24:37.727663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:24:37.727630    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" path="/var/lib/kubelet/pods/e049c064-d1bd-45cf-8515-d062bc68386f/volumes"
Jul 08 04:25:08.183873 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:08.183835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h2c8g"
Jul 08 04:25:22.393498 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.393462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:22.494766 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.494735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:22.516349 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.516314    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:22.516645 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.516628    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" containerName="discovery"
Jul 08 04:25:22.516719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.516648    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" containerName="discovery"
Jul 08 04:25:22.516769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.516730    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e049c064-d1bd-45cf-8515-d062bc68386f" containerName="discovery"
Jul 08 04:25:22.519504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.519482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:22.522182 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.522158    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 04:25:22.523109 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.523089    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qmcrf\""
Jul 08 04:25:22.523208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.523114    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 04:25:22.528985 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.528960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:22.563052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.563019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:22.658039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.657932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825l8\" (UniqueName: \"kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8\") pod \"kuadrant-operator-catalog-46qs8\" (UID: \"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5\") " pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:22.758632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.758602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825l8\" (UniqueName: \"kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8\") pod \"kuadrant-operator-catalog-46qs8\" (UID: \"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5\") " pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:22.766539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.766505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-825l8\" (UniqueName: \"kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8\") pod \"kuadrant-operator-catalog-46qs8\" (UID: \"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5\") " pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:22.831170 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.831135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:22.888746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.888706    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:22.957219 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:22.955687    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:22.961091 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:22.961060    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117ef9a7_fc2e_41c2_ae80_a0c0c283b7c5.slice/crio-d99dc5960005249d5a70f8c0cbb52b7a271b400446d1e872730105586fb96bbc WatchSource:0}: Error finding container d99dc5960005249d5a70f8c0cbb52b7a271b400446d1e872730105586fb96bbc: Status 404 returned error can't find the container with id d99dc5960005249d5a70f8c0cbb52b7a271b400446d1e872730105586fb96bbc
Jul 08 04:25:23.098451 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.098411    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph7mj"]
Jul 08 04:25:23.102685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.102660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:23.110511 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.110484    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph7mj"]
Jul 08 04:25:23.261963 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.261926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbjb\" (UniqueName: \"kubernetes.io/projected/8b408105-5beb-4992-b8fa-ec44048027ed-kube-api-access-psbjb\") pod \"kuadrant-operator-catalog-ph7mj\" (UID: \"8b408105-5beb-4992-b8fa-ec44048027ed\") " pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:23.331946 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.331909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:23.362820 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.362786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbjb\" (UniqueName: \"kubernetes.io/projected/8b408105-5beb-4992-b8fa-ec44048027ed-kube-api-access-psbjb\") pod \"kuadrant-operator-catalog-ph7mj\" (UID: \"8b408105-5beb-4992-b8fa-ec44048027ed\") " pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:23.371497 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.371466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbjb\" (UniqueName: \"kubernetes.io/projected/8b408105-5beb-4992-b8fa-ec44048027ed-kube-api-access-psbjb\") pod \"kuadrant-operator-catalog-ph7mj\" (UID: \"8b408105-5beb-4992-b8fa-ec44048027ed\") " pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:23.373404 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.373372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" event={"ID":"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5","Type":"ContainerStarted","Data":"d99dc5960005249d5a70f8c0cbb52b7a271b400446d1e872730105586fb96bbc"}
Jul 08 04:25:23.412524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.412492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:23.527258 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.527183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:23.536939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:23.536919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ph7mj"]
Jul 08 04:25:23.539113 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:23.539086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b408105_5beb_4992_b8fa_ec44048027ed.slice/crio-42488fcbc20c3063cfaa9ae6f33fb6beafcb65a13d446ac876a5eab925808524 WatchSource:0}: Error finding container 42488fcbc20c3063cfaa9ae6f33fb6beafcb65a13d446ac876a5eab925808524: Status 404 returned error can't find the container with id 42488fcbc20c3063cfaa9ae6f33fb6beafcb65a13d446ac876a5eab925808524
Jul 08 04:25:24.381002 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:24.380954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj" event={"ID":"8b408105-5beb-4992-b8fa-ec44048027ed","Type":"ContainerStarted","Data":"42488fcbc20c3063cfaa9ae6f33fb6beafcb65a13d446ac876a5eab925808524"}
Jul 08 04:25:25.386351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.386315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" event={"ID":"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5","Type":"ContainerStarted","Data":"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"}
Jul 08 04:25:25.386835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.386365    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" podUID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" containerName="registry-server" containerID="cri-o://215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243" gracePeriod=2
Jul 08 04:25:25.387728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.387701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj" event={"ID":"8b408105-5beb-4992-b8fa-ec44048027ed","Type":"ContainerStarted","Data":"fed3644691693637de3bdde52ac3645ee5d5589496d5fc9294c054b2ded19792"}
Jul 08 04:25:25.404245 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.404196    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" podStartSLOduration=1.1982719099999999 podStartE2EDuration="3.404179474s" totalImagesPullingTime="2.205907564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:25:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:25:25.40312374 +0000 UTC m=+416.323752234" watchObservedRunningTime="2026-07-08 04:25:25.404179474 +0000 UTC m=+416.324807947"
Jul 08 04:25:25.420618 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.420532    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj" podStartSLOduration=0.791958435 podStartE2EDuration="2.420519162s" totalImagesPullingTime="1.628560727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:25:25.418664994 +0000 UTC m=+416.339293469" watchObservedRunningTime="2026-07-08 04:25:25.420519162 +0000 UTC m=+416.341147635"
Jul 08 04:25:25.622649 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.622626    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:25.784106 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.784069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-825l8\" (UniqueName: \"kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8\") pod \"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5\" (UID: \"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5\") "
Jul 08 04:25:25.786223 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.786200    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8" (OuterVolumeSpecName: "kube-api-access-825l8") pod "117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" (UID: "117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5"). InnerVolumeSpecName "kube-api-access-825l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:25:25.885060 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:25.885021    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-825l8\" (UniqueName: \"kubernetes.io/projected/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5-kube-api-access-825l8\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:26.393162 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.393126    2562 generic.go:356] "Generic (PLEG): container finished" podID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" containerID="215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243" exitCode=0
Jul 08 04:25:26.393552 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.393173    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46qs8"
Jul 08 04:25:26.393552 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.393207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" event={"ID":"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5","Type":"ContainerDied","Data":"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"}
Jul 08 04:25:26.393552 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.393263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46qs8" event={"ID":"117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5","Type":"ContainerDied","Data":"d99dc5960005249d5a70f8c0cbb52b7a271b400446d1e872730105586fb96bbc"}
Jul 08 04:25:26.393552 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.393284    2562 scope.go:117] "RemoveContainer" containerID="215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"
Jul 08 04:25:26.402042 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.402024    2562 scope.go:117] "RemoveContainer" containerID="215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"
Jul 08 04:25:26.402282 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:25:26.402262    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243\": container with ID starting with 215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243 not found: ID does not exist" containerID="215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"
Jul 08 04:25:26.402322 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.402290    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243"} err="failed to get container status \"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243\": rpc error: code = NotFound desc = could not find container \"215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243\": container with ID starting with 215dcb921dfef2db755fc0387966128dd8c19dd4ccfed451cc7cc3d36c43a243 not found: ID does not exist"
Jul 08 04:25:26.416508 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.416483    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:26.422063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:26.422041    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46qs8"]
Jul 08 04:25:27.727749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:27.727720    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" path="/var/lib/kubelet/pods/117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5/volumes"
Jul 08 04:25:33.413475 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:33.413440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:33.413917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:33.413536    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:33.435323 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:33.435297    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:34.450158 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:34.450132    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ph7mj"
Jul 08 04:25:36.499063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.499030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fd94b4b95-jjhk7"]
Jul 08 04:25:36.499412 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.499293    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" containerName="registry-server"
Jul 08 04:25:36.499412 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.499303    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" containerName="registry-server"
Jul 08 04:25:36.499412 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.499367    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="117ef9a7-fc2e-41c2-ae80-a0c0c283b7c5" containerName="registry-server"
Jul 08 04:25:36.503843 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.503826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.513753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.513732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd94b4b95-jjhk7"]
Jul 08 04:25:36.545031 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.545001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:36.645421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.645390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:36.672417 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672478 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdjr\" (UniqueName: \"kubernetes.io/projected/4c1f820d-7303-47ab-809f-386a6a2c5f48-kube-api-access-cpdjr\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672478 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-oauth-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672547 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-oauth-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672547 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672651 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-service-ca\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.672651 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.672585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-trusted-ca-bundle\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773176 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-service-ca\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773176 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-trusted-ca-bundle\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773176 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdjr\" (UniqueName: \"kubernetes.io/projected/4c1f820d-7303-47ab-809f-386a6a2c5f48-kube-api-access-cpdjr\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-oauth-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773510 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-oauth-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773561 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.773882 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.773843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-service-ca\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.774073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.774052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-trusted-ca-bundle\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.774144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.774116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-oauth-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.774264 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.774143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.775668 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.775646    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-serving-cert\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.775758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.775676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c1f820d-7303-47ab-809f-386a6a2c5f48-console-oauth-config\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.781491 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.781471    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdjr\" (UniqueName: \"kubernetes.io/projected/4c1f820d-7303-47ab-809f-386a6a2c5f48-kube-api-access-cpdjr\") pod \"console-5fd94b4b95-jjhk7\" (UID: \"4c1f820d-7303-47ab-809f-386a6a2c5f48\") " pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.812984 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.812960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:36.939390 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:36.939358    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd94b4b95-jjhk7"]
Jul 08 04:25:36.942399 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:36.942372    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1f820d_7303_47ab_809f_386a6a2c5f48.slice/crio-491b08f691b91acd5597c971a27d4b630b1002dd503c7a144a4af77f64af1b9e WatchSource:0}: Error finding container 491b08f691b91acd5597c971a27d4b630b1002dd503c7a144a4af77f64af1b9e: Status 404 returned error can't find the container with id 491b08f691b91acd5597c971a27d4b630b1002dd503c7a144a4af77f64af1b9e
Jul 08 04:25:37.444165 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:37.444123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd94b4b95-jjhk7" event={"ID":"4c1f820d-7303-47ab-809f-386a6a2c5f48","Type":"ContainerStarted","Data":"4409bb00b62e90099d53a55f04065f31c3315e93af1924a293cae9c42a3405ae"}
Jul 08 04:25:37.444333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:37.444218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd94b4b95-jjhk7" event={"ID":"4c1f820d-7303-47ab-809f-386a6a2c5f48","Type":"ContainerStarted","Data":"491b08f691b91acd5597c971a27d4b630b1002dd503c7a144a4af77f64af1b9e"}
Jul 08 04:25:37.462825 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:37.462777    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fd94b4b95-jjhk7" podStartSLOduration=1.4627570460000001 podStartE2EDuration="1.462757046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:25:37.46181322 +0000 UTC m=+428.382441714" watchObservedRunningTime="2026-07-08 04:25:37.462757046 +0000 UTC m=+428.383385518"
Jul 08 04:25:38.329570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.329538    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"]
Jul 08 04:25:38.333035 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.333019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.335392 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.335368    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wxhx\""
Jul 08 04:25:38.340929 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.340908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"]
Jul 08 04:25:38.388749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.388716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.388923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.388787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrn2\" (UniqueName: \"kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.388923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.388823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.489394 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.489358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.489581 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.489468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrn2\" (UniqueName: \"kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.489581 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.489530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.489761 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.489740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.489852 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.489830    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.498176 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.498155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrn2\" (UniqueName: \"kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.642408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.642326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:38.691742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.691714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:38.761260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.761218    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"]
Jul 08 04:25:38.763645 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:38.763616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:38.764131 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:38.764107    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e14405d_1646_4b3c_8319_fd3322a9732a.slice/crio-297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078 WatchSource:0}: Error finding container 297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078: Status 404 returned error can't find the container with id 297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078
Jul 08 04:25:39.128753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.128711    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"]
Jul 08 04:25:39.132081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.132055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.140537 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.140512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"]
Jul 08 04:25:39.194179 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.194144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgb7r\" (UniqueName: \"kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.194313 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.194198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.194313 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.194232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.294821 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.294785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.295020 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.294846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgb7r\" (UniqueName: \"kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.295020 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.294912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.295234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.295214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.295234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.295226    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.303227 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.303202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgb7r\" (UniqueName: \"kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.441758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.441676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:39.455372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.455344    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerID="263898074bf8f39fd8780d886a7cdda8a69eb988b09bea65c01bb945a407821f" exitCode=0
Jul 08 04:25:39.455457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.455433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr" event={"ID":"3e14405d-1646-4b3c-8319-fd3322a9732a","Type":"ContainerDied","Data":"263898074bf8f39fd8780d886a7cdda8a69eb988b09bea65c01bb945a407821f"}
Jul 08 04:25:39.455514 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.455492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr" event={"ID":"3e14405d-1646-4b3c-8319-fd3322a9732a","Type":"ContainerStarted","Data":"297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078"}
Jul 08 04:25:39.537043 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.537009    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"]
Jul 08 04:25:39.541421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.541400    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.553010 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.552981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"]
Jul 08 04:25:39.585639 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.585617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"]
Jul 08 04:25:39.587965 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:39.587944    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0947b1c3_b7ea_47ae_9203_b1606afce6ed.slice/crio-0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd WatchSource:0}: Error finding container 0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd: Status 404 returned error can't find the container with id 0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd
Jul 08 04:25:39.597365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.597342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.597458 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.597378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.597458 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.597415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpbb\" (UniqueName: \"kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.698217 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.698151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.698217 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.698189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.698386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.698231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpbb\" (UniqueName: \"kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.698520 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.698496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.698627 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.698524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.706256 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.706238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpbb\" (UniqueName: \"kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.853987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.853949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:39.926081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.926049    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"]
Jul 08 04:25:39.931032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.930687    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:39.937254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.937205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"]
Jul 08 04:25:39.979688 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:39.979667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"]
Jul 08 04:25:39.981397 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:39.981370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b139a68_79f2_4047_b6c5_846d4c5e24de.slice/crio-fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9 WatchSource:0}: Error finding container fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9: Status 404 returned error can't find the container with id fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9
Jul 08 04:25:40.001127 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.001103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.001225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.001167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbwms\" (UniqueName: \"kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.001225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.001195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.101562 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.101535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbwms\" (UniqueName: \"kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.101690 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.101585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.101690 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.101627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.102043 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.102022    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.102253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.102111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.111589 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.111562    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbwms\" (UniqueName: \"kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.244037 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.244015    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:40.373254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.373229    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"]
Jul 08 04:25:40.386693 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:40.386666    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1605648_29e7_4299_9391_cd0f298820a6.slice/crio-2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9 WatchSource:0}: Error finding container 2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9: Status 404 returned error can't find the container with id 2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9
Jul 08 04:25:40.461673 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.461627    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerID="92bf24c475d13b7964a675ec437576cd5e79e179b281a620e636dcdf23cad8a3" exitCode=0
Jul 08 04:25:40.462175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.461702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n" event={"ID":"2b139a68-79f2-4047-b6c5-846d4c5e24de","Type":"ContainerDied","Data":"92bf24c475d13b7964a675ec437576cd5e79e179b281a620e636dcdf23cad8a3"}
Jul 08 04:25:40.462175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.461755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n" event={"ID":"2b139a68-79f2-4047-b6c5-846d4c5e24de","Type":"ContainerStarted","Data":"fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9"}
Jul 08 04:25:40.463626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.463596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerStarted","Data":"f05f54e011ee88d437c94b5a1aa99af710cf9c75d1df2ceb6da8c11b27ef5c85"}
Jul 08 04:25:40.463744 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.463648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerStarted","Data":"2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9"}
Jul 08 04:25:40.465727 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.465705    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerID="82fa807efd1c0ccd51ea95c7a6e98767c5c8708ff1fd83a147c30d38a73ce309" exitCode=0
Jul 08 04:25:40.465821 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.465773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr" event={"ID":"3e14405d-1646-4b3c-8319-fd3322a9732a","Type":"ContainerDied","Data":"82fa807efd1c0ccd51ea95c7a6e98767c5c8708ff1fd83a147c30d38a73ce309"}
Jul 08 04:25:40.469817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.468930    2562 generic.go:356] "Generic (PLEG): container finished" podID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerID="429168cd2a446966db49988562f2daeea328dc3527e8b504ec209a55d90c232e" exitCode=0
Jul 08 04:25:40.469817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.469028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz" event={"ID":"0947b1c3-b7ea-47ae-9203-b1606afce6ed","Type":"ContainerDied","Data":"429168cd2a446966db49988562f2daeea328dc3527e8b504ec209a55d90c232e"}
Jul 08 04:25:40.469817 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:40.469064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz" event={"ID":"0947b1c3-b7ea-47ae-9203-b1606afce6ed","Type":"ContainerStarted","Data":"0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd"}
Jul 08 04:25:41.475254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.475224    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1605648-29e7-4299-9391-cd0f298820a6" containerID="f05f54e011ee88d437c94b5a1aa99af710cf9c75d1df2ceb6da8c11b27ef5c85" exitCode=0
Jul 08 04:25:41.475666 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.475304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerDied","Data":"f05f54e011ee88d437c94b5a1aa99af710cf9c75d1df2ceb6da8c11b27ef5c85"}
Jul 08 04:25:41.477517 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.477437    2562 generic.go:356] "Generic (PLEG): container finished" podID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerID="145d4409edc797e89156023a0910799f72d8d253e560151bde90c7b033224df4" exitCode=0
Jul 08 04:25:41.477517 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.477501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr" event={"ID":"3e14405d-1646-4b3c-8319-fd3322a9732a","Type":"ContainerDied","Data":"145d4409edc797e89156023a0910799f72d8d253e560151bde90c7b033224df4"}
Jul 08 04:25:41.479130 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.479109    2562 generic.go:356] "Generic (PLEG): container finished" podID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerID="a45614edea75aec78f66cae563ec8dc82d6a6e709d2a4688fed171df70ae6427" exitCode=0
Jul 08 04:25:41.479238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.479213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz" event={"ID":"0947b1c3-b7ea-47ae-9203-b1606afce6ed","Type":"ContainerDied","Data":"a45614edea75aec78f66cae563ec8dc82d6a6e709d2a4688fed171df70ae6427"}
Jul 08 04:25:41.481039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.481017    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerID="de624acbecc86f5a8d31951ee1aff2f405a98cd6ce8aae06fe77aadaa78dfcaf" exitCode=0
Jul 08 04:25:41.481146 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:41.481069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n" event={"ID":"2b139a68-79f2-4047-b6c5-846d4c5e24de","Type":"ContainerDied","Data":"de624acbecc86f5a8d31951ee1aff2f405a98cd6ce8aae06fe77aadaa78dfcaf"}
Jul 08 04:25:42.487736 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.487701    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerID="6ec5bf5b74d65e1a75f46a44756f25e46a85cdf408c4aa9020c59a220720e3b1" exitCode=0
Jul 08 04:25:42.488193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.487782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n" event={"ID":"2b139a68-79f2-4047-b6c5-846d4c5e24de","Type":"ContainerDied","Data":"6ec5bf5b74d65e1a75f46a44756f25e46a85cdf408c4aa9020c59a220720e3b1"}
Jul 08 04:25:42.489506 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.489481    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1605648-29e7-4299-9391-cd0f298820a6" containerID="2ae589e15602a1eb743d4820177619db307eb3c014b3b568461d9b27764f1af3" exitCode=0
Jul 08 04:25:42.489608 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.489565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerDied","Data":"2ae589e15602a1eb743d4820177619db307eb3c014b3b568461d9b27764f1af3"}
Jul 08 04:25:42.491648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.491628    2562 generic.go:356] "Generic (PLEG): container finished" podID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerID="97104fc109d5d1098dd15149675297779bf43f00de65e95f8bfd0bd75eb45859" exitCode=0
Jul 08 04:25:42.491724 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.491662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz" event={"ID":"0947b1c3-b7ea-47ae-9203-b1606afce6ed","Type":"ContainerDied","Data":"97104fc109d5d1098dd15149675297779bf43f00de65e95f8bfd0bd75eb45859"}
Jul 08 04:25:42.615485 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.615462    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:42.622066 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.622045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util\") pod \"3e14405d-1646-4b3c-8319-fd3322a9732a\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") "
Jul 08 04:25:42.622178 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.622087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdrn2\" (UniqueName: \"kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2\") pod \"3e14405d-1646-4b3c-8319-fd3322a9732a\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") "
Jul 08 04:25:42.622178 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.622133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle\") pod \"3e14405d-1646-4b3c-8319-fd3322a9732a\" (UID: \"3e14405d-1646-4b3c-8319-fd3322a9732a\") "
Jul 08 04:25:42.622673 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.622644    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle" (OuterVolumeSpecName: "bundle") pod "3e14405d-1646-4b3c-8319-fd3322a9732a" (UID: "3e14405d-1646-4b3c-8319-fd3322a9732a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:42.624504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.624476    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2" (OuterVolumeSpecName: "kube-api-access-vdrn2") pod "3e14405d-1646-4b3c-8319-fd3322a9732a" (UID: "3e14405d-1646-4b3c-8319-fd3322a9732a"). InnerVolumeSpecName "kube-api-access-vdrn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:25:42.628021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.628001    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util" (OuterVolumeSpecName: "util") pod "3e14405d-1646-4b3c-8319-fd3322a9732a" (UID: "3e14405d-1646-4b3c-8319-fd3322a9732a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:42.723009 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.722970    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:42.723009 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.722999    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdrn2\" (UniqueName: \"kubernetes.io/projected/3e14405d-1646-4b3c-8319-fd3322a9732a-kube-api-access-vdrn2\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:42.723009 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:42.723008    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e14405d-1646-4b3c-8319-fd3322a9732a-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.503794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.503758    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1605648-29e7-4299-9391-cd0f298820a6" containerID="ed9e1fdf5246e2aeb588a848d3c812794e5e2203f98d47b1b45081c834caea79" exitCode=0
Jul 08 04:25:43.504275 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.503844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerDied","Data":"ed9e1fdf5246e2aeb588a848d3c812794e5e2203f98d47b1b45081c834caea79"}
Jul 08 04:25:43.505575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.505550    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr"
Jul 08 04:25:43.505575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.505558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr" event={"ID":"3e14405d-1646-4b3c-8319-fd3322a9732a","Type":"ContainerDied","Data":"297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078"}
Jul 08 04:25:43.505721 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.505592    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="297a3e84769b5b80712f97d1e5a15d20f3de59c7340f1ac490b0e9649f07d078"
Jul 08 04:25:43.652050 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.652027    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:43.654647 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.654622    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:43.730359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle\") pod \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") "
Jul 08 04:25:43.730543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730370    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgb7r\" (UniqueName: \"kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r\") pod \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") "
Jul 08 04:25:43.730543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730408    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util\") pod \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\" (UID: \"0947b1c3-b7ea-47ae-9203-b1606afce6ed\") "
Jul 08 04:25:43.730543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util\") pod \"2b139a68-79f2-4047-b6c5-846d4c5e24de\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") "
Jul 08 04:25:43.730543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730478    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrpbb\" (UniqueName: \"kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb\") pod \"2b139a68-79f2-4047-b6c5-846d4c5e24de\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") "
Jul 08 04:25:43.730543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.730514    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle\") pod \"2b139a68-79f2-4047-b6c5-846d4c5e24de\" (UID: \"2b139a68-79f2-4047-b6c5-846d4c5e24de\") "
Jul 08 04:25:43.731493 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.731168    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle" (OuterVolumeSpecName: "bundle") pod "2b139a68-79f2-4047-b6c5-846d4c5e24de" (UID: "2b139a68-79f2-4047-b6c5-846d4c5e24de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:43.731493 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.731441    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle" (OuterVolumeSpecName: "bundle") pod "0947b1c3-b7ea-47ae-9203-b1606afce6ed" (UID: "0947b1c3-b7ea-47ae-9203-b1606afce6ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:43.732898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.732873    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r" (OuterVolumeSpecName: "kube-api-access-lgb7r") pod "0947b1c3-b7ea-47ae-9203-b1606afce6ed" (UID: "0947b1c3-b7ea-47ae-9203-b1606afce6ed"). InnerVolumeSpecName "kube-api-access-lgb7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:25:43.733144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.733120    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb" (OuterVolumeSpecName: "kube-api-access-hrpbb") pod "2b139a68-79f2-4047-b6c5-846d4c5e24de" (UID: "2b139a68-79f2-4047-b6c5-846d4c5e24de"). InnerVolumeSpecName "kube-api-access-hrpbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:25:43.737336 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.737305    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util" (OuterVolumeSpecName: "util") pod "2b139a68-79f2-4047-b6c5-846d4c5e24de" (UID: "2b139a68-79f2-4047-b6c5-846d4c5e24de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:43.737728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.737703    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util" (OuterVolumeSpecName: "util") pod "0947b1c3-b7ea-47ae-9203-b1606afce6ed" (UID: "0947b1c3-b7ea-47ae-9203-b1606afce6ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:43.831461 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831420    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.831461 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831454    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.831461 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831464    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgb7r\" (UniqueName: \"kubernetes.io/projected/0947b1c3-b7ea-47ae-9203-b1606afce6ed-kube-api-access-lgb7r\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.831689 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831474    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0947b1c3-b7ea-47ae-9203-b1606afce6ed-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.831689 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831483    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b139a68-79f2-4047-b6c5-846d4c5e24de-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:43.831689 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:43.831491    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpbb\" (UniqueName: \"kubernetes.io/projected/2b139a68-79f2-4047-b6c5-846d4c5e24de-kube-api-access-hrpbb\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:44.512074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.512042    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n"
Jul 08 04:25:44.512484 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.512066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n" event={"ID":"2b139a68-79f2-4047-b6c5-846d4c5e24de","Type":"ContainerDied","Data":"fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9"}
Jul 08 04:25:44.512484 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.512116    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcc046490793c0cd935e710864f5754c73453fbe773db88184c3db0393d8e6a9"
Jul 08 04:25:44.513923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.513879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz" event={"ID":"0947b1c3-b7ea-47ae-9203-b1606afce6ed","Type":"ContainerDied","Data":"0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd"}
Jul 08 04:25:44.514059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.513929    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f372afc1a3bd6f56717d51dbe99dfa109168faa26cf798a4dc40707ee151dcd"
Jul 08 04:25:44.514059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.513893    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz"
Jul 08 04:25:44.638844 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.638820    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:44.736319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.736285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util\") pod \"b1605648-29e7-4299-9391-cd0f298820a6\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") "
Jul 08 04:25:44.736499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.736330    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle\") pod \"b1605648-29e7-4299-9391-cd0f298820a6\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") "
Jul 08 04:25:44.736499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.736348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbwms\" (UniqueName: \"kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms\") pod \"b1605648-29e7-4299-9391-cd0f298820a6\" (UID: \"b1605648-29e7-4299-9391-cd0f298820a6\") "
Jul 08 04:25:44.736922 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.736895    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle" (OuterVolumeSpecName: "bundle") pod "b1605648-29e7-4299-9391-cd0f298820a6" (UID: "b1605648-29e7-4299-9391-cd0f298820a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:44.738417 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.738391    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms" (OuterVolumeSpecName: "kube-api-access-tbwms") pod "b1605648-29e7-4299-9391-cd0f298820a6" (UID: "b1605648-29e7-4299-9391-cd0f298820a6"). InnerVolumeSpecName "kube-api-access-tbwms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:25:44.741593 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.741572    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util" (OuterVolumeSpecName: "util") pod "b1605648-29e7-4299-9391-cd0f298820a6" (UID: "b1605648-29e7-4299-9391-cd0f298820a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:25:44.837237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.837160    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-util\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:44.837237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.837187    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1605648-29e7-4299-9391-cd0f298820a6-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:44.837237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:44.837197    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbwms\" (UniqueName: \"kubernetes.io/projected/b1605648-29e7-4299-9391-cd0f298820a6-kube-api-access-tbwms\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:25:45.520559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:45.520531    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv"
Jul 08 04:25:45.520931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:45.520566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv" event={"ID":"b1605648-29e7-4299-9391-cd0f298820a6","Type":"ContainerDied","Data":"2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9"}
Jul 08 04:25:45.520931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:45.520611    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b2d261d57e41584a05500d79d2036713bfd66b8455ee23861a53a6c722878f9"
Jul 08 04:25:46.813098 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:46.813071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:46.813502 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:46.813114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:46.817836 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:46.817816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:47.535000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:47.534955    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fd94b4b95-jjhk7"
Jul 08 04:25:47.579580 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:47.579546    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:25:47.697432 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:47.697404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:47.798914 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:47.798817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:47.900557 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:47.900518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:51.157635 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:51.157560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:54.075692 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:54.075659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:57.100569 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100539    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"]
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100937    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100956    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100971    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100979    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.100989    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="util"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101000    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="util"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101008    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="util"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101014    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="util"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101023    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="extract"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101030    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="extract"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101040    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="extract"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101047    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="extract"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101058    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101064    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101072    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="pull"
Jul 08 04:25:57.101077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101080    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="pull"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101091    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="util"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101098    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="util"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101107    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101115    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101130    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101137    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101154    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="util"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101162    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="util"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101234    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0947b1c3-b7ea-47ae-9203-b1606afce6ed" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101247    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1605648-29e7-4299-9391-cd0f298820a6" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101258    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b139a68-79f2-4047-b6c5-846d4c5e24de" containerName="extract"
Jul 08 04:25:57.101819 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.101269    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e14405d-1646-4b3c-8319-fd3322a9732a" containerName="extract"
Jul 08 04:25:57.104599 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.104582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:25:57.107523 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.107506    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 04:25:57.107959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.107942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pskw2\""
Jul 08 04:25:57.116592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.116570    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"]
Jul 08 04:25:57.133150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.133118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7hw\" (UniqueName: \"kubernetes.io/projected/4ea1294d-9e65-4cae-bb1d-d3362f1b1d57-kube-api-access-zj7hw\") pod \"dns-operator-controller-manager-864dd78c4c-dqgwm\" (UID: \"4ea1294d-9e65-4cae-bb1d-d3362f1b1d57\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:25:57.234503 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.234451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7hw\" (UniqueName: \"kubernetes.io/projected/4ea1294d-9e65-4cae-bb1d-d3362f1b1d57-kube-api-access-zj7hw\") pod \"dns-operator-controller-manager-864dd78c4c-dqgwm\" (UID: \"4ea1294d-9e65-4cae-bb1d-d3362f1b1d57\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:25:57.242562 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.242529    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7hw\" (UniqueName: \"kubernetes.io/projected/4ea1294d-9e65-4cae-bb1d-d3362f1b1d57-kube-api-access-zj7hw\") pod \"dns-operator-controller-manager-864dd78c4c-dqgwm\" (UID: \"4ea1294d-9e65-4cae-bb1d-d3362f1b1d57\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:25:57.413602 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.413515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:25:57.552493 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.552471    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"]
Jul 08 04:25:57.555053 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:25:57.555027    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea1294d_9e65_4cae_bb1d_d3362f1b1d57.slice/crio-c72050e4bd64615c3981fa533d37244d83bf752b896b0349029b7d7c8910700b WatchSource:0}: Error finding container c72050e4bd64615c3981fa533d37244d83bf752b896b0349029b7d7c8910700b: Status 404 returned error can't find the container with id c72050e4bd64615c3981fa533d37244d83bf752b896b0349029b7d7c8910700b
Jul 08 04:25:57.577361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.577335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm" event={"ID":"4ea1294d-9e65-4cae-bb1d-d3362f1b1d57","Type":"ContainerStarted","Data":"c72050e4bd64615c3981fa533d37244d83bf752b896b0349029b7d7c8910700b"}
Jul 08 04:25:57.886576 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:57.886549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:25:58.667914 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:25:58.667851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:00.593983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:00.593950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm" event={"ID":"4ea1294d-9e65-4cae-bb1d-d3362f1b1d57","Type":"ContainerStarted","Data":"577bee8f75b9eec375b10dfc478c261103174016ca8ba807e6039ffcb551f3ef"}
Jul 08 04:26:00.594448 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:00.594020    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:26:00.611717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:00.611668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm" podStartSLOduration=1.449488598 podStartE2EDuration="3.611654936s" totalImagesPullingTime="2.162166338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:00.610318813 +0000 UTC m=+451.530947331" watchObservedRunningTime="2026-07-08 04:26:00.611654936 +0000 UTC m=+451.532283408"
Jul 08 04:26:01.355199 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.355166    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"]
Jul 08 04:26:01.358473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.358457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:01.361055 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.361028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7wjfq\""
Jul 08 04:26:01.369794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.369770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"]
Jul 08 04:26:01.465698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.465656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv56x\" (UniqueName: \"kubernetes.io/projected/1898f762-d419-4ff8-9b91-7c39d5a085d6-kube-api-access-sv56x\") pod \"authorino-operator-75cc8d5cb7-bwmp5\" (UID: \"1898f762-d419-4ff8-9b91-7c39d5a085d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:01.567001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.566963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv56x\" (UniqueName: \"kubernetes.io/projected/1898f762-d419-4ff8-9b91-7c39d5a085d6-kube-api-access-sv56x\") pod \"authorino-operator-75cc8d5cb7-bwmp5\" (UID: \"1898f762-d419-4ff8-9b91-7c39d5a085d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:01.578333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.578296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv56x\" (UniqueName: \"kubernetes.io/projected/1898f762-d419-4ff8-9b91-7c39d5a085d6-kube-api-access-sv56x\") pod \"authorino-operator-75cc8d5cb7-bwmp5\" (UID: \"1898f762-d419-4ff8-9b91-7c39d5a085d6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:01.668244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.668163    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:01.795338 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:01.795314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"]
Jul 08 04:26:01.797246 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:26:01.797220    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1898f762_d419_4ff8_9b91_7c39d5a085d6.slice/crio-906664472a28dd9b88bebc33fb3b4b8ce180d3baba7ca3841185c64653cfaae6 WatchSource:0}: Error finding container 906664472a28dd9b88bebc33fb3b4b8ce180d3baba7ca3841185c64653cfaae6: Status 404 returned error can't find the container with id 906664472a28dd9b88bebc33fb3b4b8ce180d3baba7ca3841185c64653cfaae6
Jul 08 04:26:02.076088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:02.076055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:02.606543 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:02.606398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5" event={"ID":"1898f762-d419-4ff8-9b91-7c39d5a085d6","Type":"ContainerStarted","Data":"906664472a28dd9b88bebc33fb3b4b8ce180d3baba7ca3841185c64653cfaae6"}
Jul 08 04:26:03.112247 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:03.112212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:04.617917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:04.617835    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5" event={"ID":"1898f762-d419-4ff8-9b91-7c39d5a085d6","Type":"ContainerStarted","Data":"135965836b0f23327a777b5fe2ef0fcc389d177716f841ae3eb086df6eb9ad90"}
Jul 08 04:26:04.618314 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:04.617972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:04.639139 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:04.639090    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5" podStartSLOduration=1.388684426 podStartE2EDuration="3.639074872s" totalImagesPullingTime="2.250390446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:04.636670361 +0000 UTC m=+455.557298835" watchObservedRunningTime="2026-07-08 04:26:04.639074872 +0000 UTC m=+455.559703342"
Jul 08 04:26:04.901093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:04.901014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:05.958001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:05.957965    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"]
Jul 08 04:26:05.961335 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:05.961318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:05.963888 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:05.963869    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p6hqn\""
Jul 08 04:26:05.972473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:05.972447    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"]
Jul 08 04:26:06.007209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.007172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.007356 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.007288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4zb\" (UniqueName: \"kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.107832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.107799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4zb\" (UniqueName: \"kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.107832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.107837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.108238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.108219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.116620 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.116594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4zb\" (UniqueName: \"kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.271203 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.271169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:06.347595 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.347505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:06.438523 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.438500    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"]
Jul 08 04:26:06.440381 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:26:06.440354    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3370ca21_f36e_49b7_ad48_c999fd7928bb.slice/crio-7839e816375a88e2c88e22f3c66b14ba3ce4304129862e54727fff2176fa8621 WatchSource:0}: Error finding container 7839e816375a88e2c88e22f3c66b14ba3ce4304129862e54727fff2176fa8621: Status 404 returned error can't find the container with id 7839e816375a88e2c88e22f3c66b14ba3ce4304129862e54727fff2176fa8621
Jul 08 04:26:06.627917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:06.627833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj" event={"ID":"3370ca21-f36e-49b7-ad48-c999fd7928bb","Type":"ContainerStarted","Data":"7839e816375a88e2c88e22f3c66b14ba3ce4304129862e54727fff2176fa8621"}
Jul 08 04:26:07.078073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:07.078042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:08.307139 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:08.307108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:09.287909 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.287871    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"]
Jul 08 04:26:09.291322 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.291300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:09.294560 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.294535    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4mzkc\""
Jul 08 04:26:09.300783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.300760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"]
Jul 08 04:26:09.333052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.333019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bd4z\" (UniqueName: \"kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z\") pod \"limitador-operator-controller-manager-859d7b78bd-twqgp\" (UID: \"21098545-cb56-4ea3-ae49-f5c4a7cb332e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:09.434032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.433993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bd4z\" (UniqueName: \"kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z\") pod \"limitador-operator-controller-manager-859d7b78bd-twqgp\" (UID: \"21098545-cb56-4ea3-ae49-f5c4a7cb332e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:09.450076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.450051    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bd4z\" (UniqueName: \"kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z\") pod \"limitador-operator-controller-manager-859d7b78bd-twqgp\" (UID: \"21098545-cb56-4ea3-ae49-f5c4a7cb332e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:09.602223 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.602152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:09.736383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:09.736358    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"]
Jul 08 04:26:09.739029 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:26:09.739000    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21098545_cb56_4ea3_ae49_f5c4a7cb332e.slice/crio-5c74be3c578025c4811aaa894046e7f676a72f7c00ba215cdf1bdcec50e013e6 WatchSource:0}: Error finding container 5c74be3c578025c4811aaa894046e7f676a72f7c00ba215cdf1bdcec50e013e6: Status 404 returned error can't find the container with id 5c74be3c578025c4811aaa894046e7f676a72f7c00ba215cdf1bdcec50e013e6
Jul 08 04:26:10.657949 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:10.657898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp" event={"ID":"21098545-cb56-4ea3-ae49-f5c4a7cb332e","Type":"ContainerStarted","Data":"5c74be3c578025c4811aaa894046e7f676a72f7c00ba215cdf1bdcec50e013e6"}
Jul 08 04:26:10.881977 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:10.881945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:10.981325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:10.981244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:11.601155 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:11.601120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dqgwm"
Jul 08 04:26:12.599436 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.599399    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c4d897fd5-r4hgl" podUID="e5c89e44-8e6f-4975-bf38-54156d3e37be" containerName="console" containerID="cri-o://3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1" gracePeriod=15
Jul 08 04:26:12.671961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.671933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp" event={"ID":"21098545-cb56-4ea3-ae49-f5c4a7cb332e","Type":"ContainerStarted","Data":"c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11"}
Jul 08 04:26:12.672144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.672071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:12.688314 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.688261    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp" podStartSLOduration=2.063151129 podStartE2EDuration="3.688246922s" totalImagesPullingTime="1.625095793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:12.687197204 +0000 UTC m=+463.607825677" watchObservedRunningTime="2026-07-08 04:26:12.688246922 +0000 UTC m=+463.608875388"
Jul 08 04:26:12.855092 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.855068    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:26:12.962754 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.962723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.962919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.962772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.962919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.962794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.963062 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.962924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.963062 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.962977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz56d\" (UniqueName: \"kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.963062 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963019    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.963208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963064    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca\") pod \"e5c89e44-8e6f-4975-bf38-54156d3e37be\" (UID: \"e5c89e44-8e6f-4975-bf38-54156d3e37be\") "
Jul 08 04:26:12.963208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963124    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config" (OuterVolumeSpecName: "console-config") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:26:12.963311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963254    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:26:12.963359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963309    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:26:12.963424 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963405    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-config\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:12.963480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963428    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-oauth-serving-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:12.963480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963438    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-trusted-ca-bundle\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:12.963480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.963412    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:26:12.965032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.965006    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:26:12.965129 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.965072    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:26:12.965129 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:12.965079    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d" (OuterVolumeSpecName: "kube-api-access-vz56d") pod "e5c89e44-8e6f-4975-bf38-54156d3e37be" (UID: "e5c89e44-8e6f-4975-bf38-54156d3e37be"). InnerVolumeSpecName "kube-api-access-vz56d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:26:13.063987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.063910    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz56d\" (UniqueName: \"kubernetes.io/projected/e5c89e44-8e6f-4975-bf38-54156d3e37be-kube-api-access-vz56d\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:13.063987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.063937    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-serving-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:13.063987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.063947    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5c89e44-8e6f-4975-bf38-54156d3e37be-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:13.063987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.063956    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5c89e44-8e6f-4975-bf38-54156d3e37be-console-oauth-config\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:13.678607 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.678569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj" event={"ID":"3370ca21-f36e-49b7-ad48-c999fd7928bb","Type":"ContainerStarted","Data":"d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de"}
Jul 08 04:26:13.679083 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.678634    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:13.679831 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.679806    2562 generic.go:356] "Generic (PLEG): container finished" podID="e5c89e44-8e6f-4975-bf38-54156d3e37be" containerID="3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1" exitCode=0
Jul 08 04:26:13.679928 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.679840    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4d897fd5-r4hgl"
Jul 08 04:26:13.679928 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.679890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4d897fd5-r4hgl" event={"ID":"e5c89e44-8e6f-4975-bf38-54156d3e37be","Type":"ContainerDied","Data":"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"}
Jul 08 04:26:13.679998 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.679937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4d897fd5-r4hgl" event={"ID":"e5c89e44-8e6f-4975-bf38-54156d3e37be","Type":"ContainerDied","Data":"d1b970bd1cd7ca19fe253e3790e44cc56fb031b9893be7ce4bf8bb37ce6beffe"}
Jul 08 04:26:13.679998 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.679963    2562 scope.go:117] "RemoveContainer" containerID="3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"
Jul 08 04:26:13.689037 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.689021    2562 scope.go:117] "RemoveContainer" containerID="3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"
Jul 08 04:26:13.689294 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:13.689276    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1\": container with ID starting with 3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1 not found: ID does not exist" containerID="3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"
Jul 08 04:26:13.689341 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.689303    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1"} err="failed to get container status \"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1\": rpc error: code = NotFound desc = could not find container \"3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1\": container with ID starting with 3ebae25ce0ff71ad6a9fac09ca3c8a0eb1b9d056af06cbca3f148d2b5d4e7af1 not found: ID does not exist"
Jul 08 04:26:13.698221 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.698181    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj" podStartSLOduration=2.582710161 podStartE2EDuration="8.698159072s" totalImagesPullingTime="6.115448911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:13.69627814 +0000 UTC m=+464.616906612" watchObservedRunningTime="2026-07-08 04:26:13.698159072 +0000 UTC m=+464.618787543"
Jul 08 04:26:13.711429 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.711399    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:26:13.713234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.713216    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c4d897fd5-r4hgl"]
Jul 08 04:26:13.735336 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:13.735301    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5c89e44-8e6f-4975-bf38-54156d3e37be" path="/var/lib/kubelet/pods/e5c89e44-8e6f-4975-bf38-54156d3e37be/volumes"
Jul 08 04:26:15.285409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:15.285380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:15.551045 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:15.550959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:15.624894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:15.624850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bwmp5"
Jul 08 04:26:16.490712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:16.490682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:16.592272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:16.592239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:16.867353 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:16.867270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:16.970830 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:16.970801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:20.476568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:20.476541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:20.528631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:20.528600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:23.682143 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:23.682111    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:23.824168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:23.824133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:24.687496 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:24.687462    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.413362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.413314    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"]
Jul 08 04:26:26.413987 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.413556    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" containerName="manager" containerID="cri-o://d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de" gracePeriod=2
Jul 08 04:26:26.426076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.426050    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"]
Jul 08 04:26:26.433316 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.433283    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3370ca21-f36e-49b7-ad48-c999fd7928bb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.436548 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.436529    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:26.436888 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.436850    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c89e44-8e6f-4975-bf38-54156d3e37be" containerName="console"
Jul 08 04:26:26.436888 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.436886    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c89e44-8e6f-4975-bf38-54156d3e37be" containerName="console"
Jul 08 04:26:26.437044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.436910    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" containerName="manager"
Jul 08 04:26:26.437044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.436919    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" containerName="manager"
Jul 08 04:26:26.437044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.437011    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5c89e44-8e6f-4975-bf38-54156d3e37be" containerName="console"
Jul 08 04:26:26.437044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.437028    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" containerName="manager"
Jul 08 04:26:26.439955 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.439938    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"]
Jul 08 04:26:26.440084 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.440064    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" containerName="manager" containerID="cri-o://c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11" gracePeriod=2
Jul 08 04:26:26.440151 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.440106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.452981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.452954    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"]
Jul 08 04:26:26.454026 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.453997    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.458066 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.458044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:26.469021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.468994    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"]
Jul 08 04:26:26.469408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.469390    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" containerName="manager"
Jul 08 04:26:26.469480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.469411    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" containerName="manager"
Jul 08 04:26:26.469521 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.469493    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" containerName="manager"
Jul 08 04:26:26.472453 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.472436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:26.475760 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.475736    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.477761 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.477734    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.480132 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.480100    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.481686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.481610    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"]
Jul 08 04:26:26.481877 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.481818    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.570274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.570235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.570422 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.570298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl646\" (UniqueName: \"kubernetes.io/projected/1a6138ce-403c-48cb-8fba-f0fd78b8cc6d-kube-api-access-cl646\") pod \"limitador-operator-controller-manager-859d7b78bd-9r44m\" (UID: \"1a6138ce-403c-48cb-8fba-f0fd78b8cc6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:26.570422 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.570342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ngp\" (UniqueName: \"kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.671597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.671549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl646\" (UniqueName: \"kubernetes.io/projected/1a6138ce-403c-48cb-8fba-f0fd78b8cc6d-kube-api-access-cl646\") pod \"limitador-operator-controller-manager-859d7b78bd-9r44m\" (UID: \"1a6138ce-403c-48cb-8fba-f0fd78b8cc6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:26.671680 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.671649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ngp\" (UniqueName: \"kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.671731 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.671719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.671932 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.671912    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.672112 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.672090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.673908 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.673874    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.675016 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.675002    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.677077 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.677051    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.679123 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.679099    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.681259 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.681235    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.684051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.684031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ngp\" (UniqueName: \"kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z5fsv\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.684151 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.684135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl646\" (UniqueName: \"kubernetes.io/projected/1a6138ce-403c-48cb-8fba-f0fd78b8cc6d-kube-api-access-cl646\") pod \"limitador-operator-controller-manager-859d7b78bd-9r44m\" (UID: \"1a6138ce-403c-48cb-8fba-f0fd78b8cc6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:26.744537 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.744507    2562 generic.go:356] "Generic (PLEG): container finished" podID="3370ca21-f36e-49b7-ad48-c999fd7928bb" containerID="d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de" exitCode=0
Jul 08 04:26:26.744700 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.744548    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.744700 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.744603    2562 scope.go:117] "RemoveContainer" containerID="d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de"
Jul 08 04:26:26.745753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.745731    2562 generic.go:356] "Generic (PLEG): container finished" podID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" containerID="c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11" exitCode=0
Jul 08 04:26:26.745838 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.745781    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.747297 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.747271    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.749611 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.749589    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.752545 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.752523    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:26.753312 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.753294    2562 scope.go:117] "RemoveContainer" containerID="d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de"
Jul 08 04:26:26.753567 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.753551    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de\": container with ID starting with d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de not found: ID does not exist" containerID="d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de"
Jul 08 04:26:26.753626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.753573    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de"} err="failed to get container status \"d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de\": rpc error: code = NotFound desc = could not find container \"d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de\": container with ID starting with d04e95ec1f3daadfabc21dcb71893ccbdf10fde73a517e726588a9fdb46934de not found: ID does not exist"
Jul 08 04:26:26.753626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.753588    2562 scope.go:117] "RemoveContainer" containerID="c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11"
Jul 08 04:26:26.754769 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.754751    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:26.760954 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.760937    2562 scope.go:117] "RemoveContainer" containerID="c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11"
Jul 08 04:26:26.761226 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:26.761207    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11\": container with ID starting with c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11 not found: ID does not exist" containerID="c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11"
Jul 08 04:26:26.761279 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.761233    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11"} err="failed to get container status \"c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11\": rpc error: code = NotFound desc = could not find container \"c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11\": container with ID starting with c1e53d84efa2fa35b6a06c51d8942bbd5b2244595e1722f5af87bff00e713d11 not found: ID does not exist"
Jul 08 04:26:26.772654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.772629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq4zb\" (UniqueName: \"kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb\") pod \"3370ca21-f36e-49b7-ad48-c999fd7928bb\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") "
Jul 08 04:26:26.772737 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.772678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume\") pod \"3370ca21-f36e-49b7-ad48-c999fd7928bb\" (UID: \"3370ca21-f36e-49b7-ad48-c999fd7928bb\") "
Jul 08 04:26:26.772737 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.772698    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bd4z\" (UniqueName: \"kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z\") pod \"21098545-cb56-4ea3-ae49-f5c4a7cb332e\" (UID: \"21098545-cb56-4ea3-ae49-f5c4a7cb332e\") "
Jul 08 04:26:26.773180 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.773154    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3370ca21-f36e-49b7-ad48-c999fd7928bb" (UID: "3370ca21-f36e-49b7-ad48-c999fd7928bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:26:26.774679 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.774659    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb" (OuterVolumeSpecName: "kube-api-access-dq4zb") pod "3370ca21-f36e-49b7-ad48-c999fd7928bb" (UID: "3370ca21-f36e-49b7-ad48-c999fd7928bb"). InnerVolumeSpecName "kube-api-access-dq4zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:26:26.774747 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.774685    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z" (OuterVolumeSpecName: "kube-api-access-4bd4z") pod "21098545-cb56-4ea3-ae49-f5c4a7cb332e" (UID: "21098545-cb56-4ea3-ae49-f5c4a7cb332e"). InnerVolumeSpecName "kube-api-access-4bd4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:26:26.852950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.852917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:26.858297 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.858279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:26.874073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.874051    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq4zb\" (UniqueName: \"kubernetes.io/projected/3370ca21-f36e-49b7-ad48-c999fd7928bb-kube-api-access-dq4zb\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:26.874133 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.874075    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3370ca21-f36e-49b7-ad48-c999fd7928bb-extensions-socket-volume\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:26.874133 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.874086    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bd4z\" (UniqueName: \"kubernetes.io/projected/21098545-cb56-4ea3-ae49-f5c4a7cb332e-kube-api-access-4bd4z\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:26.926621 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:26.926469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:27.010405 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.010306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:27.013464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.013425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"]
Jul 08 04:26:27.013524 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:26:27.013471    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4016c946_23cc_4723_90e3_686d78e6b61b.slice/crio-2a4085cd2f73fd8186dcdfc470ac723158a852e100fa1351ff823d58779614be WatchSource:0}: Error finding container 2a4085cd2f73fd8186dcdfc470ac723158a852e100fa1351ff823d58779614be: Status 404 returned error can't find the container with id 2a4085cd2f73fd8186dcdfc470ac723158a852e100fa1351ff823d58779614be
Jul 08 04:26:27.015628 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:26:27.015604    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6138ce_403c_48cb_8fba_f0fd78b8cc6d.slice/crio-125f2717ad465a67ba6a3273750189f761a110134c14bf7a7c88493724c13924 WatchSource:0}: Error finding container 125f2717ad465a67ba6a3273750189f761a110134c14bf7a7c88493724c13924: Status 404 returned error can't find the container with id 125f2717ad465a67ba6a3273750189f761a110134c14bf7a7c88493724c13924
Jul 08 04:26:27.021088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.021068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:27.061330 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:27.061303    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:27.063122 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:27.063085    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:27.064987 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:27.064965    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ptwmj\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ptwmj"
Jul 08 04:26:27.066976 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:27.066774    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twqgp\" is forbidden: User \"system:node:ip-10-0-143-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-106.ec2.internal' and this object" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twqgp"
Jul 08 04:26:27.728188 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.728159    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21098545-cb56-4ea3-ae49-f5c4a7cb332e" path="/var/lib/kubelet/pods/21098545-cb56-4ea3-ae49-f5c4a7cb332e/volumes"
Jul 08 04:26:27.728535 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.728476    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3370ca21-f36e-49b7-ad48-c999fd7928bb" path="/var/lib/kubelet/pods/3370ca21-f36e-49b7-ad48-c999fd7928bb/volumes"
Jul 08 04:26:27.754395 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.754362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m" event={"ID":"1a6138ce-403c-48cb-8fba-f0fd78b8cc6d","Type":"ContainerStarted","Data":"0e6ff951f472f83ed80f795f54c8148339c005e955d213f9b5b7962d0ebda751"}
Jul 08 04:26:27.754590 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.754415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m" event={"ID":"1a6138ce-403c-48cb-8fba-f0fd78b8cc6d","Type":"ContainerStarted","Data":"125f2717ad465a67ba6a3273750189f761a110134c14bf7a7c88493724c13924"}
Jul 08 04:26:27.754590 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.754526    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:27.755925 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.755902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" event={"ID":"4016c946-23cc-4723-90e3-686d78e6b61b","Type":"ContainerStarted","Data":"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"}
Jul 08 04:26:27.756019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.755941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" event={"ID":"4016c946-23cc-4723-90e3-686d78e6b61b","Type":"ContainerStarted","Data":"2a4085cd2f73fd8186dcdfc470ac723158a852e100fa1351ff823d58779614be"}
Jul 08 04:26:27.756059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.756023    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:27.773890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.773827    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m" podStartSLOduration=1.7738141710000002 podStartE2EDuration="1.773814171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:27.772108388 +0000 UTC m=+478.692736878" watchObservedRunningTime="2026-07-08 04:26:27.773814171 +0000 UTC m=+478.694442643"
Jul 08 04:26:27.791686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:27.791640    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" podStartSLOduration=1.791626975 podStartE2EDuration="1.791626975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:26:27.790131534 +0000 UTC m=+478.710760017" watchObservedRunningTime="2026-07-08 04:26:27.791626975 +0000 UTC m=+478.712255509"
Jul 08 04:26:29.492811 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:29.492778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:29.595097 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:29.595065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:34.890089 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:34.890055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:34.943458 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:34.943426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:35.301592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:35.301561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:35.402412 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:35.402379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:38.763367 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:38.763336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:38.763836 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:38.763418    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9r44m"
Jul 08 04:26:38.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:38.900471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:39.002595 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:39.002565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:41.137100 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:41.137067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:45.328749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:45.328712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:45.429663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:45.429631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:56.931796 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:56.931764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:26:58.015250 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.015216    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:58.015796 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.015468    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" podUID="4016c946-23cc-4723-90e3-686d78e6b61b" containerName="manager" containerID="cri-o://f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35" gracePeriod=10
Jul 08 04:26:58.262547 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.262515    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:58.337147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.337058    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume\") pod \"4016c946-23cc-4723-90e3-686d78e6b61b\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") "
Jul 08 04:26:58.337147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.337121    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9ngp\" (UniqueName: \"kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp\") pod \"4016c946-23cc-4723-90e3-686d78e6b61b\" (UID: \"4016c946-23cc-4723-90e3-686d78e6b61b\") "
Jul 08 04:26:58.337492 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.337467    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4016c946-23cc-4723-90e3-686d78e6b61b" (UID: "4016c946-23cc-4723-90e3-686d78e6b61b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:26:58.339181 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.339155    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp" (OuterVolumeSpecName: "kube-api-access-p9ngp") pod "4016c946-23cc-4723-90e3-686d78e6b61b" (UID: "4016c946-23cc-4723-90e3-686d78e6b61b"). InnerVolumeSpecName "kube-api-access-p9ngp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:26:58.437910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.437842    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9ngp\" (UniqueName: \"kubernetes.io/projected/4016c946-23cc-4723-90e3-686d78e6b61b-kube-api-access-p9ngp\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:58.437910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.437903    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4016c946-23cc-4723-90e3-686d78e6b61b-extensions-socket-volume\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:26:58.905389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.905358    2562 generic.go:356] "Generic (PLEG): container finished" podID="4016c946-23cc-4723-90e3-686d78e6b61b" containerID="f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35" exitCode=0
Jul 08 04:26:58.905597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.905412    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"
Jul 08 04:26:58.905597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.905453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" event={"ID":"4016c946-23cc-4723-90e3-686d78e6b61b","Type":"ContainerDied","Data":"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"}
Jul 08 04:26:58.905597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.905506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv" event={"ID":"4016c946-23cc-4723-90e3-686d78e6b61b","Type":"ContainerDied","Data":"2a4085cd2f73fd8186dcdfc470ac723158a852e100fa1351ff823d58779614be"}
Jul 08 04:26:58.905597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.905528    2562 scope.go:117] "RemoveContainer" containerID="f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"
Jul 08 04:26:58.914632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.914614    2562 scope.go:117] "RemoveContainer" containerID="f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"
Jul 08 04:26:58.914892 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:26:58.914871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35\": container with ID starting with f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35 not found: ID does not exist" containerID="f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"
Jul 08 04:26:58.914954 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.914901    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35"} err="failed to get container status \"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35\": rpc error: code = NotFound desc = could not find container \"f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35\": container with ID starting with f066a9a80fc1193f391b408f85a1acad5db11dcb4ef6833b6c08a808c86cbe35 not found: ID does not exist"
Jul 08 04:26:58.929903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.929873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:58.942249 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:58.942220    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z5fsv"]
Jul 08 04:26:59.727587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:26:59.727553    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4016c946-23cc-4723-90e3-686d78e6b61b" path="/var/lib/kubelet/pods/4016c946-23cc-4723-90e3-686d78e6b61b/volumes"
Jul 08 04:27:11.574735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:11.574704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:11.676545 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:11.676519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:14.336167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.336134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"]
Jul 08 04:27:14.336556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.336451    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4016c946-23cc-4723-90e3-686d78e6b61b" containerName="manager"
Jul 08 04:27:14.336556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.336462    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4016c946-23cc-4723-90e3-686d78e6b61b" containerName="manager"
Jul 08 04:27:14.336556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.336525    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4016c946-23cc-4723-90e3-686d78e6b61b" containerName="manager"
Jul 08 04:27:14.340794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.340777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.343715 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.343690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 04:27:14.343921 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.343876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 04:27:14.348464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.344245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 04:27:14.348464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.344275    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tdpd2\""
Jul 08 04:27:14.352290 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.352047    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"]
Jul 08 04:27:14.367165 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.367140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:14.459781 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb08810a-6d91-4faf-bc23-706012943271-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.459965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.459948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdf4x\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-kube-api-access-cdf4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.460209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.460007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb08810a-6d91-4faf-bc23-706012943271-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.460209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.460076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.467029 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.467005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:14.560845 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb08810a-6d91-4faf-bc23-706012943271-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdf4x\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-kube-api-access-cdf4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb08810a-6d91-4faf-bc23-706012943271-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.560980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561263    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561341    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561591 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.561675 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.561655    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb08810a-6d91-4faf-bc23-706012943271-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.563271 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.563250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb08810a-6d91-4faf-bc23-706012943271-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.563487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.563469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb08810a-6d91-4faf-bc23-706012943271-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.571528 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.571507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.571709 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.571688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdf4x\" (UniqueName: \"kubernetes.io/projected/cb08810a-6d91-4faf-bc23-706012943271-kube-api-access-cdf4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-zbxzq\" (UID: \"cb08810a-6d91-4faf-bc23-706012943271\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.653794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.653692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:14.787683 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.787659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"]
Jul 08 04:27:14.789524 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:27:14.789503    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb08810a_6d91_4faf_bc23_706012943271.slice/crio-f24b134bf0eb58eece89b1b28761e95bd5ca0c7a5f26d22a7f6e1cfcde28ba3d WatchSource:0}: Error finding container f24b134bf0eb58eece89b1b28761e95bd5ca0c7a5f26d22a7f6e1cfcde28ba3d: Status 404 returned error can't find the container with id f24b134bf0eb58eece89b1b28761e95bd5ca0c7a5f26d22a7f6e1cfcde28ba3d
Jul 08 04:27:14.980657 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:14.980625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" event={"ID":"cb08810a-6d91-4faf-bc23-706012943271","Type":"ContainerStarted","Data":"f24b134bf0eb58eece89b1b28761e95bd5ca0c7a5f26d22a7f6e1cfcde28ba3d"}
Jul 08 04:27:18.050067 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:18.050033    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:27:18.050320 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:18.050111    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:27:18.050320 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:18.050142    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:27:19.003175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.003139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" event={"ID":"cb08810a-6d91-4faf-bc23-706012943271","Type":"ContainerStarted","Data":"f7aa661e4d6c1e982adf14b05459113fe336576891ccddb70446c6a465a6fff6"}
Jul 08 04:27:19.025814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.025764    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" podStartSLOduration=1.767320797 podStartE2EDuration="5.025747903s" totalImagesPullingTime="3.258427106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:27:19.024637678 +0000 UTC m=+529.945266173" watchObservedRunningTime="2026-07-08 04:27:19.025747903 +0000 UTC m=+529.946376374"
Jul 08 04:27:19.654635 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.654600    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:19.659182 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.659160    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:19.991004 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.990971    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:19.994427 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.994407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:19.996682 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.996659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wxhx\""
Jul 08 04:27:19.996682 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.996660    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 04:27:19.997090 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:19.997073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:20.002175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.002149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:20.008343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.008322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:20.009294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.009277    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:27:20.089226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.089194    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:20.098148 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.098113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:20.106348 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.106321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.106531 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.106357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qngxv\" (UniqueName: \"kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.151308 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.151275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:20.207673 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.207639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.207853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.207690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qngxv\" (UniqueName: \"kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.208288 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.208270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.215542 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.215516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qngxv\" (UniqueName: \"kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv\") pod \"limitador-limitador-64c94fd64f-mdhb9\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.305544 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.305454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:20.436077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.436052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:20.438089 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:27:20.438061    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd22e8c_880c_41ed_a9ca_804ad158d067.slice/crio-887ba26cf5b9c2ab0665ad893e49919b5fc29f67de6b0b8c23ede496c1624f38 WatchSource:0}: Error finding container 887ba26cf5b9c2ab0665ad893e49919b5fc29f67de6b0b8c23ede496c1624f38: Status 404 returned error can't find the container with id 887ba26cf5b9c2ab0665ad893e49919b5fc29f67de6b0b8c23ede496c1624f38
Jul 08 04:27:20.781525 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.781495    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:20.786255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.786232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:20.788497 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.788478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mv9l9\""
Jul 08 04:27:20.794382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.794362    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:20.809317 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.809290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:20.909827 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.909796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:20.912958 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:20.912932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlnnz\" (UniqueName: \"kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz\") pod \"authorino-58cd955675-f8pxl\" (UID: \"35806d67-8ebc-4e1f-b826-a5f93042eed4\") " pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:21.013841 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:21.013754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlnnz\" (UniqueName: \"kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz\") pod \"authorino-58cd955675-f8pxl\" (UID: \"35806d67-8ebc-4e1f-b826-a5f93042eed4\") " pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:21.014768 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:21.014744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" event={"ID":"acd22e8c-880c-41ed-a9ca-804ad158d067","Type":"ContainerStarted","Data":"887ba26cf5b9c2ab0665ad893e49919b5fc29f67de6b0b8c23ede496c1624f38"}
Jul 08 04:27:21.021917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:21.021896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlnnz\" (UniqueName: \"kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz\") pod \"authorino-58cd955675-f8pxl\" (UID: \"35806d67-8ebc-4e1f-b826-a5f93042eed4\") " pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:21.095890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:21.095785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:21.270268 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:21.270160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:21.272293 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:27:21.272254    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35806d67_8ebc_4e1f_b826_a5f93042eed4.slice/crio-8cab7ccfe152942bc83b803b63f171b7aa7aaa8101d1e305e7483418f1af3569 WatchSource:0}: Error finding container 8cab7ccfe152942bc83b803b63f171b7aa7aaa8101d1e305e7483418f1af3569: Status 404 returned error can't find the container with id 8cab7ccfe152942bc83b803b63f171b7aa7aaa8101d1e305e7483418f1af3569
Jul 08 04:27:22.026766 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:22.026725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8pxl" event={"ID":"35806d67-8ebc-4e1f-b826-a5f93042eed4","Type":"ContainerStarted","Data":"8cab7ccfe152942bc83b803b63f171b7aa7aaa8101d1e305e7483418f1af3569"}
Jul 08 04:27:25.044747 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.044701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8pxl" event={"ID":"35806d67-8ebc-4e1f-b826-a5f93042eed4","Type":"ContainerStarted","Data":"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"}
Jul 08 04:27:25.046939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.046914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" event={"ID":"acd22e8c-880c-41ed-a9ca-804ad158d067","Type":"ContainerStarted","Data":"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"}
Jul 08 04:27:25.047081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.047030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:25.060488 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.060428    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f8pxl" podStartSLOduration=1.433859528 podStartE2EDuration="5.060414985s" totalImagesPullingTime="3.626555457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:27:25.060164153 +0000 UTC m=+535.980792627" watchObservedRunningTime="2026-07-08 04:27:25.060414985 +0000 UTC m=+535.981043495"
Jul 08 04:27:25.081365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.081308    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" podStartSLOduration=1.6774637060000002 podStartE2EDuration="6.081292273s" totalImagesPullingTime="4.403828567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:27:25.079267214 +0000 UTC m=+535.999895718" watchObservedRunningTime="2026-07-08 04:27:25.081292273 +0000 UTC m=+536.001920744"
Jul 08 04:27:25.191020 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:25.190930    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:27.056349 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:27.056308    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f8pxl" podUID="35806d67-8ebc-4e1f-b826-a5f93042eed4" containerName="authorino" containerID="cri-o://a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9" gracePeriod=30
Jul 08 04:27:27.295411 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:27.295384    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:27.370577 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:27.370485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlnnz\" (UniqueName: \"kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz\") pod \"35806d67-8ebc-4e1f-b826-a5f93042eed4\" (UID: \"35806d67-8ebc-4e1f-b826-a5f93042eed4\") "
Jul 08 04:27:27.372529 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:27.372495    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz" (OuterVolumeSpecName: "kube-api-access-tlnnz") pod "35806d67-8ebc-4e1f-b826-a5f93042eed4" (UID: "35806d67-8ebc-4e1f-b826-a5f93042eed4"). InnerVolumeSpecName "kube-api-access-tlnnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:27:27.471988 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:27.471949    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlnnz\" (UniqueName: \"kubernetes.io/projected/35806d67-8ebc-4e1f-b826-a5f93042eed4-kube-api-access-tlnnz\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:27:28.062601 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.062515    2562 generic.go:356] "Generic (PLEG): container finished" podID="35806d67-8ebc-4e1f-b826-a5f93042eed4" containerID="a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9" exitCode=0
Jul 08 04:27:28.062601 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.062556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f8pxl"
Jul 08 04:27:28.063076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.062603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8pxl" event={"ID":"35806d67-8ebc-4e1f-b826-a5f93042eed4","Type":"ContainerDied","Data":"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"}
Jul 08 04:27:28.063076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.062654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f8pxl" event={"ID":"35806d67-8ebc-4e1f-b826-a5f93042eed4","Type":"ContainerDied","Data":"8cab7ccfe152942bc83b803b63f171b7aa7aaa8101d1e305e7483418f1af3569"}
Jul 08 04:27:28.063076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.062715    2562 scope.go:117] "RemoveContainer" containerID="a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"
Jul 08 04:27:28.076487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.076471    2562 scope.go:117] "RemoveContainer" containerID="a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"
Jul 08 04:27:28.076730 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:27:28.076708    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9\": container with ID starting with a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9 not found: ID does not exist" containerID="a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"
Jul 08 04:27:28.076820 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.076732    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9"} err="failed to get container status \"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9\": rpc error: code = NotFound desc = could not find container \"a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9\": container with ID starting with a791aa1220ebb0d98fdbde15e4b8d031daaea32907955ba8bad6d0f9d41107f9 not found: ID does not exist"
Jul 08 04:27:28.093668 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.093640    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:28.109335 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:28.109311    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f8pxl"]
Jul 08 04:27:29.727842 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:29.727813    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35806d67-8ebc-4e1f-b826-a5f93042eed4" path="/var/lib/kubelet/pods/35806d67-8ebc-4e1f-b826-a5f93042eed4/volumes"
Jul 08 04:27:36.053024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.052987    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:36.207683 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.207651    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:36.207918 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.207893    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" podUID="acd22e8c-880c-41ed-a9ca-804ad158d067" containerName="limitador" containerID="cri-o://25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68" gracePeriod=30
Jul 08 04:27:36.755431 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.755404    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:36.850656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.850569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qngxv\" (UniqueName: \"kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv\") pod \"acd22e8c-880c-41ed-a9ca-804ad158d067\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") "
Jul 08 04:27:36.850656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.850606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file\") pod \"acd22e8c-880c-41ed-a9ca-804ad158d067\" (UID: \"acd22e8c-880c-41ed-a9ca-804ad158d067\") "
Jul 08 04:27:36.851030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.851008    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file" (OuterVolumeSpecName: "config-file") pod "acd22e8c-880c-41ed-a9ca-804ad158d067" (UID: "acd22e8c-880c-41ed-a9ca-804ad158d067"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:27:36.852784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.852763    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv" (OuterVolumeSpecName: "kube-api-access-qngxv") pod "acd22e8c-880c-41ed-a9ca-804ad158d067" (UID: "acd22e8c-880c-41ed-a9ca-804ad158d067"). InnerVolumeSpecName "kube-api-access-qngxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:27:36.951912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.951874    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qngxv\" (UniqueName: \"kubernetes.io/projected/acd22e8c-880c-41ed-a9ca-804ad158d067-kube-api-access-qngxv\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:27:36.951912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:36.951908    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/acd22e8c-880c-41ed-a9ca-804ad158d067-config-file\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:27:37.109438 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.109344    2562 generic.go:356] "Generic (PLEG): container finished" podID="acd22e8c-880c-41ed-a9ca-804ad158d067" containerID="25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68" exitCode=0
Jul 08 04:27:37.109438 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.109392    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"
Jul 08 04:27:37.109956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.109391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" event={"ID":"acd22e8c-880c-41ed-a9ca-804ad158d067","Type":"ContainerDied","Data":"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"}
Jul 08 04:27:37.109956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.109497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mdhb9" event={"ID":"acd22e8c-880c-41ed-a9ca-804ad158d067","Type":"ContainerDied","Data":"887ba26cf5b9c2ab0665ad893e49919b5fc29f67de6b0b8c23ede496c1624f38"}
Jul 08 04:27:37.109956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.109525    2562 scope.go:117] "RemoveContainer" containerID="25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"
Jul 08 04:27:37.117777 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.117757    2562 scope.go:117] "RemoveContainer" containerID="25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"
Jul 08 04:27:37.118054 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:27:37.118031    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68\": container with ID starting with 25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68 not found: ID does not exist" containerID="25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"
Jul 08 04:27:37.118114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.118061    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68"} err="failed to get container status \"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68\": rpc error: code = NotFound desc = could not find container \"25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68\": container with ID starting with 25246b8c269f5f81e59b27391d9ce22fbe7c8dd4a09a36ac802f8115e9750e68 not found: ID does not exist"
Jul 08 04:27:37.155696 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.154257    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:37.158669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.158642    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mdhb9"]
Jul 08 04:27:37.728255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:37.728223    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd22e8c-880c-41ed-a9ca-804ad158d067" path="/var/lib/kubelet/pods/acd22e8c-880c-41ed-a9ca-804ad158d067/volumes"
Jul 08 04:27:40.031410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:40.031378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:41.273039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.273005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:41.388673 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.388641    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:41.731954 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.731925    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"]
Jul 08 04:27:41.732292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732276    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd22e8c-880c-41ed-a9ca-804ad158d067" containerName="limitador"
Jul 08 04:27:41.732382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732294    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd22e8c-880c-41ed-a9ca-804ad158d067" containerName="limitador"
Jul 08 04:27:41.732382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732327    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35806d67-8ebc-4e1f-b826-a5f93042eed4" containerName="authorino"
Jul 08 04:27:41.732382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732337    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="35806d67-8ebc-4e1f-b826-a5f93042eed4" containerName="authorino"
Jul 08 04:27:41.732537 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732425    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="35806d67-8ebc-4e1f-b826-a5f93042eed4" containerName="authorino"
Jul 08 04:27:41.732537 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.732437    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd22e8c-880c-41ed-a9ca-804ad158d067" containerName="limitador"
Jul 08 04:27:41.736606 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.736585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:41.739445 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.739425    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 04:27:41.739445 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.739440    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 04:27:41.740037 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.739997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 04:27:41.741309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.741279    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-c8q7m\""
Jul 08 04:27:41.746510 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.746263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"]
Jul 08 04:27:41.764708 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.764681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:41.893728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.893691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-data\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:41.893932 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.893744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hblg\" (UniqueName: \"kubernetes.io/projected/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-kube-api-access-5hblg\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:41.994972 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.994837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-data\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:41.994972 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.994956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hblg\" (UniqueName: \"kubernetes.io/projected/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-kube-api-access-5hblg\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:41.995311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:41.995284    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-data\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:42.010555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:42.010525    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hblg\" (UniqueName: \"kubernetes.io/projected/2446d3c6-6dca-4ba3-876c-f2583e9a2d45-kube-api-access-5hblg\") pod \"postgres-69fb4594cf-smv5c\" (UID: \"2446d3c6-6dca-4ba3-876c-f2583e9a2d45\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:42.051316 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:42.051283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:42.207150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:42.207118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"]
Jul 08 04:27:42.208790 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:27:42.208759    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2446d3c6_6dca_4ba3_876c_f2583e9a2d45.slice/crio-62b49f6c2fcd109d110c50ec46fb87bf093c1a4d863757f90724d593d017b5cf WatchSource:0}: Error finding container 62b49f6c2fcd109d110c50ec46fb87bf093c1a4d863757f90724d593d017b5cf: Status 404 returned error can't find the container with id 62b49f6c2fcd109d110c50ec46fb87bf093c1a4d863757f90724d593d017b5cf
Jul 08 04:27:43.141736 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:43.141691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c" event={"ID":"2446d3c6-6dca-4ba3-876c-f2583e9a2d45","Type":"ContainerStarted","Data":"62b49f6c2fcd109d110c50ec46fb87bf093c1a4d863757f90724d593d017b5cf"}
Jul 08 04:27:48.171113 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:48.171019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c" event={"ID":"2446d3c6-6dca-4ba3-876c-f2583e9a2d45","Type":"ContainerStarted","Data":"10048fecf7f21b6fac7f7526b91c4c96c72fa2c6ead471e89f24850b48a8a3c7"}
Jul 08 04:27:48.171470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:48.171158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:48.191078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:48.191030    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c" podStartSLOduration=1.6428197180000002 podStartE2EDuration="7.191013103s" totalImagesPullingTime="5.548193385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:27:48.188675855 +0000 UTC m=+559.109304326" watchObservedRunningTime="2026-07-08 04:27:48.191013103 +0000 UTC m=+559.111641585"
Jul 08 04:27:54.208473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.208445    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smv5c"
Jul 08 04:27:54.505406 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.505375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:54.725927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.725889    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bnmj7"]
Jul 08 04:27:54.729207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.729184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:54.731625 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.731599    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mv9l9\""
Jul 08 04:27:54.737051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.737014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bnmj7"]
Jul 08 04:27:54.914450 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.914350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstmm\" (UniqueName: \"kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm\") pod \"authorino-5d4b67c446-bnmj7\" (UID: \"a2a64280-93a5-4b7a-b250-9838a2f4827c\") " pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:54.948652 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.948619    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bnmj7"]
Jul 08 04:27:54.948897 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:27:54.948878    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jstmm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-bnmj7" podUID="a2a64280-93a5-4b7a-b250-9838a2f4827c"
Jul 08 04:27:54.969347 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.969320    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cbb59f648-bvmvl"]
Jul 08 04:27:54.972460 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.972441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:54.982282 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:54.982255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cbb59f648-bvmvl"]
Jul 08 04:27:55.015452 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.015419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstmm\" (UniqueName: \"kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm\") pod \"authorino-5d4b67c446-bnmj7\" (UID: \"a2a64280-93a5-4b7a-b250-9838a2f4827c\") " pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:55.025331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.025309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstmm\" (UniqueName: \"kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm\") pod \"authorino-5d4b67c446-bnmj7\" (UID: \"a2a64280-93a5-4b7a-b250-9838a2f4827c\") " pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:55.080818 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.080783    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cbb59f648-bvmvl"]
Jul 08 04:27:55.081063 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:27:55.081044    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5pkd7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5cbb59f648-bvmvl" podUID="a01b8445-11b0-4b13-b73e-dc783e7af272"
Jul 08 04:27:55.115932 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.115898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pkd7\" (UniqueName: \"kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7\") pod \"authorino-5cbb59f648-bvmvl\" (UID: \"a01b8445-11b0-4b13-b73e-dc783e7af272\") " pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:55.207759 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.207686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:55.207933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.207686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:55.217172 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.217150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pkd7\" (UniqueName: \"kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7\") pod \"authorino-5cbb59f648-bvmvl\" (UID: \"a01b8445-11b0-4b13-b73e-dc783e7af272\") " pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:55.217612 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.217598    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:55.219981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.219964    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:55.228341 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.228321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pkd7\" (UniqueName: \"kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7\") pod \"authorino-5cbb59f648-bvmvl\" (UID: \"a01b8445-11b0-4b13-b73e-dc783e7af272\") " pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:55.419395 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.419362    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jstmm\" (UniqueName: \"kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm\") pod \"a2a64280-93a5-4b7a-b250-9838a2f4827c\" (UID: \"a2a64280-93a5-4b7a-b250-9838a2f4827c\") "
Jul 08 04:27:55.419395 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.419395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pkd7\" (UniqueName: \"kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7\") pod \"a01b8445-11b0-4b13-b73e-dc783e7af272\" (UID: \"a01b8445-11b0-4b13-b73e-dc783e7af272\") "
Jul 08 04:27:55.421498 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.421462    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7" (OuterVolumeSpecName: "kube-api-access-5pkd7") pod "a01b8445-11b0-4b13-b73e-dc783e7af272" (UID: "a01b8445-11b0-4b13-b73e-dc783e7af272"). InnerVolumeSpecName "kube-api-access-5pkd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:27:55.421675 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.421654    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm" (OuterVolumeSpecName: "kube-api-access-jstmm") pod "a2a64280-93a5-4b7a-b250-9838a2f4827c" (UID: "a2a64280-93a5-4b7a-b250-9838a2f4827c"). InnerVolumeSpecName "kube-api-access-jstmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:27:55.520161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.520122    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jstmm\" (UniqueName: \"kubernetes.io/projected/a2a64280-93a5-4b7a-b250-9838a2f4827c-kube-api-access-jstmm\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:27:55.520161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.520155    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pkd7\" (UniqueName: \"kubernetes.io/projected/a01b8445-11b0-4b13-b73e-dc783e7af272-kube-api-access-5pkd7\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:27:55.982064 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:55.982028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:27:56.213170 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.213140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bnmj7"
Jul 08 04:27:56.213318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.213140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbb59f648-bvmvl"
Jul 08 04:27:56.240665 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.240591    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bnmj7"]
Jul 08 04:27:56.244838 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.244813    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bnmj7"]
Jul 08 04:27:56.267260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.267232    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cbb59f648-bvmvl"]
Jul 08 04:27:56.274450 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:56.274423    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cbb59f648-bvmvl"]
Jul 08 04:27:57.727309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:57.727278    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a01b8445-11b0-4b13-b73e-dc783e7af272" path="/var/lib/kubelet/pods/a01b8445-11b0-4b13-b73e-dc783e7af272/volumes"
Jul 08 04:27:57.727678 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:27:57.727509    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a64280-93a5-4b7a-b250-9838a2f4827c" path="/var/lib/kubelet/pods/a2a64280-93a5-4b7a-b250-9838a2f4827c/volumes"
Jul 08 04:28:00.491758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.491725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:00.562875 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.562822    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:00.568329 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.568304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.571237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.571216    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 04:28:00.571381 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.571296    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hhppf\""
Jul 08 04:28:00.571555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.571539    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 04:28:00.576763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.576744    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:00.658347 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.658313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:00.660303 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.660286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.660365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.660313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.660365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.660334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtzr\" (UniqueName: \"kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.721006 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.720976    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:28:00.723251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.723234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.727632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.727611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:00.732979 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.732959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:28:00.761104 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5rm\" (UniqueName: \"kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.761104 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.761104 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.761319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.761319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtzr\" (UniqueName: \"kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.761319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.761743 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.761724    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.763346 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.763330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.769984 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.769964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtzr\" (UniqueName: \"kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr\") pod \"maas-controller-75cc69c559-d2hsx\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") " pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:00.830094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.830064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:00.861587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.861548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.861744 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.861624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5rm\" (UniqueName: \"kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.861744 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.861651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.862394 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.862369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.863943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.863927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.870244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.870217    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5rm\" (UniqueName: \"kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm\") pod \"maas-controller-55c7f6b5f9-dq694\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") " pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:00.878896 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:00.878876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:01.006209 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:01.006187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:01.007515 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:28:01.007489    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f35682_415f_49e8_966e_a1bed1a2f4ee.slice/crio-7389a1359d538fd0dedb0f99c822b5f95eb7ba3bce36db54540e920ae5ed82fb WatchSource:0}: Error finding container 7389a1359d538fd0dedb0f99c822b5f95eb7ba3bce36db54540e920ae5ed82fb: Status 404 returned error can't find the container with id 7389a1359d538fd0dedb0f99c822b5f95eb7ba3bce36db54540e920ae5ed82fb
Jul 08 04:28:01.033510 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:01.033485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:01.159628 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:01.159605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:28:01.161023 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:28:01.160994    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9525b8e4_5181_419b_b6e2_09da558347a2.slice/crio-90d7b36a12622bf29e7bd624e0fbc0bf8faa7ba9d3e657d861d3bea1dc125dc0 WatchSource:0}: Error finding container 90d7b36a12622bf29e7bd624e0fbc0bf8faa7ba9d3e657d861d3bea1dc125dc0: Status 404 returned error can't find the container with id 90d7b36a12622bf29e7bd624e0fbc0bf8faa7ba9d3e657d861d3bea1dc125dc0
Jul 08 04:28:01.243033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:01.242997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75cc69c559-d2hsx" event={"ID":"c6f35682-415f-49e8-966e-a1bed1a2f4ee","Type":"ContainerStarted","Data":"7389a1359d538fd0dedb0f99c822b5f95eb7ba3bce36db54540e920ae5ed82fb"}
Jul 08 04:28:01.244043 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:01.244021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" event={"ID":"9525b8e4-5181-419b-b6e2-09da558347a2","Type":"ContainerStarted","Data":"90d7b36a12622bf29e7bd624e0fbc0bf8faa7ba9d3e657d861d3bea1dc125dc0"}
Jul 08 04:28:03.270333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.270294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" event={"ID":"9525b8e4-5181-419b-b6e2-09da558347a2","Type":"ContainerStarted","Data":"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"}
Jul 08 04:28:03.270831 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.270498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:03.271954 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.271918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75cc69c559-d2hsx" event={"ID":"c6f35682-415f-49e8-966e-a1bed1a2f4ee","Type":"ContainerStarted","Data":"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"}
Jul 08 04:28:03.272087 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.272062    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:03.288944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.288886    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" podStartSLOduration=1.261248353 podStartE2EDuration="3.288871079s" totalImagesPullingTime="2.027622726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:28:03.286553417 +0000 UTC m=+574.207181904" watchObservedRunningTime="2026-07-08 04:28:03.288871079 +0000 UTC m=+574.209499541"
Jul 08 04:28:03.304993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.304943    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75cc69c559-d2hsx" podStartSLOduration=1.133975423 podStartE2EDuration="3.304928382s" totalImagesPullingTime="2.170952959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:28:03.303452458 +0000 UTC m=+574.224080963" watchObservedRunningTime="2026-07-08 04:28:03.304928382 +0000 UTC m=+574.225556853"
Jul 08 04:28:03.410216 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.410186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:03.515215 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:03.515177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:14.282739 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.282700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:28:14.283194 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.282901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:14.346928 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.346899    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:14.347105 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.347078    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75cc69c559-d2hsx" podUID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" containerName="manager" containerID="cri-o://efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01" gracePeriod=30
Jul 08 04:28:14.580355 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.580324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:14.681867 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.681838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert\") pod \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") "
Jul 08 04:28:14.682023 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.681973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmtzr\" (UniqueName: \"kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr\") pod \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") "
Jul 08 04:28:14.682023 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.682017    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca\") pod \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\" (UID: \"c6f35682-415f-49e8-966e-a1bed1a2f4ee\") "
Jul 08 04:28:14.682377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.682350    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6f35682-415f-49e8-966e-a1bed1a2f4ee" (UID: "c6f35682-415f-49e8-966e-a1bed1a2f4ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:28:14.684098 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.684071    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c6f35682-415f-49e8-966e-a1bed1a2f4ee" (UID: "c6f35682-415f-49e8-966e-a1bed1a2f4ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:28:14.684208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.684145    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr" (OuterVolumeSpecName: "kube-api-access-gmtzr") pod "c6f35682-415f-49e8-966e-a1bed1a2f4ee" (UID: "c6f35682-415f-49e8-966e-a1bed1a2f4ee"). InnerVolumeSpecName "kube-api-access-gmtzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:28:14.782903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.782840    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c6f35682-415f-49e8-966e-a1bed1a2f4ee-webhook-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:28:14.782903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.782896    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmtzr\" (UniqueName: \"kubernetes.io/projected/c6f35682-415f-49e8-966e-a1bed1a2f4ee-kube-api-access-gmtzr\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:28:14.782903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:14.782907    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f35682-415f-49e8-966e-a1bed1a2f4ee-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:28:15.334392 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.334358    2562 generic.go:356] "Generic (PLEG): container finished" podID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" containerID="efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01" exitCode=0
Jul 08 04:28:15.334894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.334405    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75cc69c559-d2hsx"
Jul 08 04:28:15.334894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.334451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75cc69c559-d2hsx" event={"ID":"c6f35682-415f-49e8-966e-a1bed1a2f4ee","Type":"ContainerDied","Data":"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"}
Jul 08 04:28:15.334894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.334511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75cc69c559-d2hsx" event={"ID":"c6f35682-415f-49e8-966e-a1bed1a2f4ee","Type":"ContainerDied","Data":"7389a1359d538fd0dedb0f99c822b5f95eb7ba3bce36db54540e920ae5ed82fb"}
Jul 08 04:28:15.334894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.334549    2562 scope.go:117] "RemoveContainer" containerID="efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"
Jul 08 04:28:15.343609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.343593    2562 scope.go:117] "RemoveContainer" containerID="efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"
Jul 08 04:28:15.343878 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:28:15.343840    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01\": container with ID starting with efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01 not found: ID does not exist" containerID="efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"
Jul 08 04:28:15.343940 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.343881    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01"} err="failed to get container status \"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01\": rpc error: code = NotFound desc = could not find container \"efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01\": container with ID starting with efa0de22365cd8b24cab6620177796587fc7d48354acf0c1735867040b889c01 not found: ID does not exist"
Jul 08 04:28:15.357106 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.357082    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:15.361236 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.361215    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75cc69c559-d2hsx"]
Jul 08 04:28:15.728115 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:15.728083    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" path="/var/lib/kubelet/pods/c6f35682-415f-49e8-966e-a1bed1a2f4ee/volumes"
Jul 08 04:28:20.635145 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:20.635109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:29.535813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:29.535783    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:28:29.535813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:29.535804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:28:33.424126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.424079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:33.912372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.912348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:33.964749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.964713    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-587556f958-rsv8t"]
Jul 08 04:28:33.965061 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.965049    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" containerName="manager"
Jul 08 04:28:33.965110 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.965063    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" containerName="manager"
Jul 08 04:28:33.965144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.965117    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f35682-415f-49e8-966e-a1bed1a2f4ee" containerName="manager"
Jul 08 04:28:33.967849 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.967834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:33.971216 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.971196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 04:28:33.971351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.971283    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7lh5k\""
Jul 08 04:28:33.987303 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:33.987280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-587556f958-rsv8t"]
Jul 08 04:28:34.052744 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.052702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvj5\" (UniqueName: \"kubernetes.io/projected/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-kube-api-access-7mvj5\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.052950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.052761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-openshift-service-ca\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.052950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.052835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.153508 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.153471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvj5\" (UniqueName: \"kubernetes.io/projected/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-kube-api-access-7mvj5\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.153686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.153532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-openshift-service-ca\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.153686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.153557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.153686 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:28:34.153656    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 04:28:34.153807 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:28:34.153715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls podName:bdcc7a0f-fb9a-4391-95a8-4733fa3db990 nodeName:}" failed. No retries permitted until 2026-07-08 04:28:34.653699154 +0000 UTC m=+605.574327605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls") pod "maas-api-587556f958-rsv8t" (UID: "bdcc7a0f-fb9a-4391-95a8-4733fa3db990") : secret "maas-api-serving-cert" not found
Jul 08 04:28:34.154223 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.154204    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-openshift-service-ca\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.162507 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.162439    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvj5\" (UniqueName: \"kubernetes.io/projected/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-kube-api-access-7mvj5\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.378185 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.378151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:34.480032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.479998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:34.574217 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.574173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:34.658844 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.658804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.661232 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.661210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdcc7a0f-fb9a-4391-95a8-4733fa3db990-maas-api-tls\") pod \"maas-api-587556f958-rsv8t\" (UID: \"bdcc7a0f-fb9a-4391-95a8-4733fa3db990\") " pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:34.877903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:34.877786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:35.015187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:35.015162    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-587556f958-rsv8t"]
Jul 08 04:28:35.017298 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:28:35.017266    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcc7a0f_fb9a_4391_95a8_4733fa3db990.slice/crio-f099b955d941c0054c4e39d7371f40045836dec02bd2898bb01aba05f1253668 WatchSource:0}: Error finding container f099b955d941c0054c4e39d7371f40045836dec02bd2898bb01aba05f1253668: Status 404 returned error can't find the container with id f099b955d941c0054c4e39d7371f40045836dec02bd2898bb01aba05f1253668
Jul 08 04:28:35.434625 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:35.434583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t" event={"ID":"bdcc7a0f-fb9a-4391-95a8-4733fa3db990","Type":"ContainerStarted","Data":"f099b955d941c0054c4e39d7371f40045836dec02bd2898bb01aba05f1253668"}
Jul 08 04:28:37.470313 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:37.470260    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t" event={"ID":"bdcc7a0f-fb9a-4391-95a8-4733fa3db990","Type":"ContainerStarted","Data":"86af82db59b8cc466dd7bd3185b12a8246078b9e64fa39b1138e1ab101ebd2d4"}
Jul 08 04:28:37.470724 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:37.470414    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:37.488367 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:37.488315    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t" podStartSLOduration=2.690199765 podStartE2EDuration="4.488299576s" totalImagesPullingTime="1.798099811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:28:37.485809706 +0000 UTC m=+608.406438178" watchObservedRunningTime="2026-07-08 04:28:37.488299576 +0000 UTC m=+608.408928048"
Jul 08 04:28:42.496666 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.496634    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb08810a-6d91-4faf-bc23-706012943271" containerID="f7aa661e4d6c1e982adf14b05459113fe336576891ccddb70446c6a465a6fff6" exitCode=0
Jul 08 04:28:42.497183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.496712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" event={"ID":"cb08810a-6d91-4faf-bc23-706012943271","Type":"ContainerDied","Data":"f7aa661e4d6c1e982adf14b05459113fe336576891ccddb70446c6a465a6fff6"}
Jul 08 04:28:42.497183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.497109    2562 scope.go:117] "RemoveContainer" containerID="f7aa661e4d6c1e982adf14b05459113fe336576891ccddb70446c6a465a6fff6"
Jul 08 04:28:42.498093 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.498063    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:28:42.498183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.498134    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:28:42.498183 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:42.498167    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:28:43.480012 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:43.479983    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-587556f958-rsv8t"
Jul 08 04:28:43.509513 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:43.509477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" event={"ID":"cb08810a-6d91-4faf-bc23-706012943271","Type":"ContainerStarted","Data":"2e8953d7f6ec6ed9932642fb1ed1b24750cc931d7ec3609c85c33c5e7ea464f8"}
Jul 08 04:28:43.654070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:43.654027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:28:43.654303 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:43.654283    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zbxzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 04:28:43.654351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:43.654330    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" podUID="cb08810a-6d91-4faf-bc23-706012943271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 04:28:44.443796 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:44.443760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:44.542202 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:44.542163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:28:44.655052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:44.655014    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zbxzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 04:28:44.655226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:44.655082    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" podUID="cb08810a-6d91-4faf-bc23-706012943271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 04:28:45.655292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:45.655252    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zbxzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 04:28:45.655716 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:45.655322    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" podUID="cb08810a-6d91-4faf-bc23-706012943271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 04:28:46.654536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:46.654495    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zbxzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 08 04:28:46.654748 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:46.654551    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq" podUID="cb08810a-6d91-4faf-bc23-706012943271" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 08 04:28:47.657926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:47.657886    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:28:47.658375 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:47.658161    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:28:47.658944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:47.658922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zbxzq"
Jul 08 04:28:50.325849 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:28:50.325811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:04.890434 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.890401    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"]
Jul 08 04:29:04.893903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.893881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.897814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.897789    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 04:29:04.897814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.897809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zrrld\""
Jul 08 04:29:04.898019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.897808    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 04:29:04.898019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.897812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 04:29:04.902544 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.902525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"]
Jul 08 04:29:04.907730 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.907705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.907841 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.907751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.907841 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.907815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.907962 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.907915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.908017 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.907976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.908069 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.908038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkhq\" (UniqueName: \"kubernetes.io/projected/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-kube-api-access-bgkhq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:04.994892 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:04.994838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:05.008756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.008919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.008919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkhq\" (UniqueName: \"kubernetes.io/projected/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-kube-api-access-bgkhq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.008919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.008919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.008919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.008904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.009294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.009270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.009294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.009282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.009479 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.009335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.011032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.011011    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.011204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.011189    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.017430 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.017408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkhq\" (UniqueName: \"kubernetes.io/projected/46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285-kube-api-access-bgkhq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wzg7q\" (UID: \"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.205697 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.205606    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:05.331974 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.331950    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"]
Jul 08 04:29:05.334390 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:29:05.334352    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ec55ea_85eb_4a6b_8e7c_0fcc0f29b285.slice/crio-4ce449ed944ea97444a64946bfe158ffc706c098d1751b759f46ee56f49db1c8 WatchSource:0}: Error finding container 4ce449ed944ea97444a64946bfe158ffc706c098d1751b759f46ee56f49db1c8: Status 404 returned error can't find the container with id 4ce449ed944ea97444a64946bfe158ffc706c098d1751b759f46ee56f49db1c8
Jul 08 04:29:05.335792 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.335773    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:29:05.618710 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:05.618669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q" event={"ID":"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285","Type":"ContainerStarted","Data":"4ce449ed944ea97444a64946bfe158ffc706c098d1751b759f46ee56f49db1c8"}
Jul 08 04:29:06.625086 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:06.624997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q" event={"ID":"46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285","Type":"ContainerStarted","Data":"5b4ad8ecd9076f28317c9caf4d8d9f82461c5a4f68f4f8322261674c48d4939c"}
Jul 08 04:29:06.643192 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:06.643141    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q" podStartSLOduration=1.6476720519999999 podStartE2EDuration="2.643127216s" totalImagesPullingTime="995.455164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:29:06.640433929 +0000 UTC m=+637.561062419" watchObservedRunningTime="2026-07-08 04:29:06.643127216 +0000 UTC m=+637.563755688"
Jul 08 04:29:09.388644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.388606    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"]
Jul 08 04:29:09.393198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.393174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.395509 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.395489    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 04:29:09.403002 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.402982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"]
Jul 08 04:29:09.446930 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.446900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.447080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.446941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.447080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.447018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.447080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.447050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.447080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.447077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.447234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.447126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvxj\" (UniqueName: \"kubernetes.io/projected/9408df12-1066-4d87-aa2a-bcc94a6a9c74-kube-api-access-9rvxj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.494908 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.494853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:09.548306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvxj\" (UniqueName: \"kubernetes.io/projected/9408df12-1066-4d87-aa2a-bcc94a6a9c74-kube-api-access-9rvxj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548813    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.548962 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.548943    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.550654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.550630    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9408df12-1066-4d87-aa2a-bcc94a6a9c74-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.550925 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.550909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9408df12-1066-4d87-aa2a-bcc94a6a9c74-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.556918 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.556896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvxj\" (UniqueName: \"kubernetes.io/projected/9408df12-1066-4d87-aa2a-bcc94a6a9c74-kube-api-access-9rvxj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dlp6h\" (UID: \"9408df12-1066-4d87-aa2a-bcc94a6a9c74\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.704630 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.704536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:09.839824 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:09.839798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"]
Jul 08 04:29:09.841663 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:29:09.841635    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9408df12_1066_4d87_aa2a_bcc94a6a9c74.slice/crio-d7d240168288a39b96af3724bd5dcd30dd13da93869ffb8a4342bda01c64a827 WatchSource:0}: Error finding container d7d240168288a39b96af3724bd5dcd30dd13da93869ffb8a4342bda01c64a827: Status 404 returned error can't find the container with id d7d240168288a39b96af3724bd5dcd30dd13da93869ffb8a4342bda01c64a827
Jul 08 04:29:10.649828 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:10.649794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h" event={"ID":"9408df12-1066-4d87-aa2a-bcc94a6a9c74","Type":"ContainerStarted","Data":"24e87d92bbc4128333d190658e1af342e297b3cbc950ab1bdebbe99abd374760"}
Jul 08 04:29:10.650242 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:10.649843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h" event={"ID":"9408df12-1066-4d87-aa2a-bcc94a6a9c74","Type":"ContainerStarted","Data":"d7d240168288a39b96af3724bd5dcd30dd13da93869ffb8a4342bda01c64a827"}
Jul 08 04:29:10.667493 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:10.667437    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h" podStartSLOduration=1.4550650969999999 podStartE2EDuration="1.667419774s" totalImagesPullingTime="212.354677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:29:10.665692538 +0000 UTC m=+641.586321063" watchObservedRunningTime="2026-07-08 04:29:10.667419774 +0000 UTC m=+641.588048284"
Jul 08 04:29:15.205983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:15.205943    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:15.206502 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:15.206024    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:15.218095 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:15.218070    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:15.684697 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:15.684662    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wzg7q"
Jul 08 04:29:16.490656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:16.490626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:19.705277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:19.705241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:19.705685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:19.705323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:19.719043 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:19.719016    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:20.709719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:20.709688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dlp6h"
Jul 08 04:29:38.897916 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:38.897875    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"]
Jul 08 04:29:38.901439 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:38.901420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:38.903924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:38.903906    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 04:29:38.911192 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:38.911158    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"]
Jul 08 04:29:38.924021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:38.923984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:39.005136 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.005331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.005331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.005331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmwl\" (UniqueName: \"kubernetes.io/projected/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-kube-api-access-2bmwl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.005331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.005331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.005295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106252 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmwl\" (UniqueName: \"kubernetes.io/projected/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-kube-api-access-2bmwl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106745    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.106944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.106905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.108705 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.108681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.108852 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.108835    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.114034 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.114014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmwl\" (UniqueName: \"kubernetes.io/projected/3b251318-c8d7-4ca3-8c03-cdefc06b35fa-kube-api-access-2bmwl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tqdrr\" (UID: \"3b251318-c8d7-4ca3-8c03-cdefc06b35fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.213795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.213711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:39.350245 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.350220    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"]
Jul 08 04:29:39.352399 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:29:39.352374    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b251318_c8d7_4ca3_8c03_cdefc06b35fa.slice/crio-e9dd9e78ab44bd0563bb330275f440a14e97a7e97ecb841abbba15306c577e23 WatchSource:0}: Error finding container e9dd9e78ab44bd0563bb330275f440a14e97a7e97ecb841abbba15306c577e23: Status 404 returned error can't find the container with id e9dd9e78ab44bd0563bb330275f440a14e97a7e97ecb841abbba15306c577e23
Jul 08 04:29:39.798779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.798693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr" event={"ID":"3b251318-c8d7-4ca3-8c03-cdefc06b35fa","Type":"ContainerStarted","Data":"e09420ab7711f9f49e8186b1fccf3124d7728487ad9d40175eab8a301e047d5c"}
Jul 08 04:29:39.798779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.798744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr" event={"ID":"3b251318-c8d7-4ca3-8c03-cdefc06b35fa","Type":"ContainerStarted","Data":"e9dd9e78ab44bd0563bb330275f440a14e97a7e97ecb841abbba15306c577e23"}
Jul 08 04:29:39.815443 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:39.815381    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr" podStartSLOduration=1.644359971 podStartE2EDuration="1.81536754s" totalImagesPullingTime="171.007569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:29:39.814578744 +0000 UTC m=+670.735207249" watchObservedRunningTime="2026-07-08 04:29:39.81536754 +0000 UTC m=+670.735996012"
Jul 08 04:29:47.806362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:47.806331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:29:49.214820 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:49.214791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:49.215260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:49.214891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:49.227146 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:49.227124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:29:49.863633 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:29:49.863603    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tqdrr"
Jul 08 04:30:39.468943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:30:39.468906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:30:42.374523 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:30:42.374490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:30:42.476056 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:30:42.476025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:30:43.542076 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:30:43.542042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:30:43.636373 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:30:43.636336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:31:53.499153 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:53.499063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:31:53.651746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:53.651710    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:31:53.651943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:53.651924    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" podUID="9525b8e4-5181-419b-b6e2-09da558347a2" containerName="manager" containerID="cri-o://a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875" gracePeriod=30
Jul 08 04:31:53.905331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:53.905304    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:31:54.052388 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.052295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p5rm\" (UniqueName: \"kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm\") pod \"9525b8e4-5181-419b-b6e2-09da558347a2\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") "
Jul 08 04:31:54.052388 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.052384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert\") pod \"9525b8e4-5181-419b-b6e2-09da558347a2\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") "
Jul 08 04:31:54.052622 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.052404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca\") pod \"9525b8e4-5181-419b-b6e2-09da558347a2\" (UID: \"9525b8e4-5181-419b-b6e2-09da558347a2\") "
Jul 08 04:31:54.052833 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.052807    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "9525b8e4-5181-419b-b6e2-09da558347a2" (UID: "9525b8e4-5181-419b-b6e2-09da558347a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:31:54.054392 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.054368    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9525b8e4-5181-419b-b6e2-09da558347a2" (UID: "9525b8e4-5181-419b-b6e2-09da558347a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:31:54.054487 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.054467    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm" (OuterVolumeSpecName: "kube-api-access-2p5rm") pod "9525b8e4-5181-419b-b6e2-09da558347a2" (UID: "9525b8e4-5181-419b-b6e2-09da558347a2"). InnerVolumeSpecName "kube-api-access-2p5rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:31:54.153071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.153024    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p5rm\" (UniqueName: \"kubernetes.io/projected/9525b8e4-5181-419b-b6e2-09da558347a2-kube-api-access-2p5rm\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:31:54.153071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.153066    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9525b8e4-5181-419b-b6e2-09da558347a2-webhook-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:31:54.153071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.153079    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9525b8e4-5181-419b-b6e2-09da558347a2-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:31:54.479609 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.479573    2562 generic.go:356] "Generic (PLEG): container finished" podID="9525b8e4-5181-419b-b6e2-09da558347a2" containerID="a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875" exitCode=0
Jul 08 04:31:54.479779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.479626    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-dq694"
Jul 08 04:31:54.479779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.479658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" event={"ID":"9525b8e4-5181-419b-b6e2-09da558347a2","Type":"ContainerDied","Data":"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"}
Jul 08 04:31:54.479779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.479722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-dq694" event={"ID":"9525b8e4-5181-419b-b6e2-09da558347a2","Type":"ContainerDied","Data":"90d7b36a12622bf29e7bd624e0fbc0bf8faa7ba9d3e657d861d3bea1dc125dc0"}
Jul 08 04:31:54.479779 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.479746    2562 scope.go:117] "RemoveContainer" containerID="a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"
Jul 08 04:31:54.491694 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.491677    2562 scope.go:117] "RemoveContainer" containerID="a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"
Jul 08 04:31:54.492024 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:31:54.491997    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875\": container with ID starting with a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875 not found: ID does not exist" containerID="a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"
Jul 08 04:31:54.492131 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.492029    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875"} err="failed to get container status \"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875\": rpc error: code = NotFound desc = could not find container \"a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875\": container with ID starting with a81876bbe2ac1be41caff50e532b0eb7e84000432da8f4aed688d39eca617875 not found: ID does not exist"
Jul 08 04:31:54.502252 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.502227    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:31:54.506323 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:54.506301    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-dq694"]
Jul 08 04:31:55.141653 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.141604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:31:55.244333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.244294    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-nhq5s"]
Jul 08 04:31:55.244710 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.244692    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9525b8e4-5181-419b-b6e2-09da558347a2" containerName="manager"
Jul 08 04:31:55.244798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.244713    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9525b8e4-5181-419b-b6e2-09da558347a2" containerName="manager"
Jul 08 04:31:55.244889 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.244810    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9525b8e4-5181-419b-b6e2-09da558347a2" containerName="manager"
Jul 08 04:31:55.248988 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.248967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.252720 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.252698    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 04:31:55.252720 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.252715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hhppf\""
Jul 08 04:31:55.252923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.252755    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 04:31:55.256408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.256384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-nhq5s"]
Jul 08 04:31:55.264030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.264007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvks\" (UniqueName: \"kubernetes.io/projected/34b207c4-5b64-4cdd-bc7d-ae682ee36797-kube-api-access-tjvks\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.264150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.264057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34b207c4-5b64-4cdd-bc7d-ae682ee36797-service-ca\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.264150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.264127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34b207c4-5b64-4cdd-bc7d-ae682ee36797-webhook-cert\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.365174 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.365139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34b207c4-5b64-4cdd-bc7d-ae682ee36797-service-ca\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.365359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.365226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34b207c4-5b64-4cdd-bc7d-ae682ee36797-webhook-cert\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.365359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.365264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvks\" (UniqueName: \"kubernetes.io/projected/34b207c4-5b64-4cdd-bc7d-ae682ee36797-kube-api-access-tjvks\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.365784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.365763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34b207c4-5b64-4cdd-bc7d-ae682ee36797-service-ca\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.367647 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.367625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34b207c4-5b64-4cdd-bc7d-ae682ee36797-webhook-cert\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.374369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.374342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvks\" (UniqueName: \"kubernetes.io/projected/34b207c4-5b64-4cdd-bc7d-ae682ee36797-kube-api-access-tjvks\") pod \"maas-controller-55c7f6b5f9-nhq5s\" (UID: \"34b207c4-5b64-4cdd-bc7d-ae682ee36797\") " pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.559564 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.559527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:55.686587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.686563    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55c7f6b5f9-nhq5s"]
Jul 08 04:31:55.688216 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:31:55.688195    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b207c4_5b64_4cdd_bc7d_ae682ee36797.slice/crio-027d4eaaed8d8fd5b18f1b4868cd2e0659e4f83c68a07da6f4b2b60b941f522e WatchSource:0}: Error finding container 027d4eaaed8d8fd5b18f1b4868cd2e0659e4f83c68a07da6f4b2b60b941f522e: Status 404 returned error can't find the container with id 027d4eaaed8d8fd5b18f1b4868cd2e0659e4f83c68a07da6f4b2b60b941f522e
Jul 08 04:31:55.728897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:55.728851    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9525b8e4-5181-419b-b6e2-09da558347a2" path="/var/lib/kubelet/pods/9525b8e4-5181-419b-b6e2-09da558347a2/volumes"
Jul 08 04:31:56.492050 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:56.492016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s" event={"ID":"34b207c4-5b64-4cdd-bc7d-ae682ee36797","Type":"ContainerStarted","Data":"5b2b8f84a242c41cea2883e7ace6453580b8ee6c240be144c1973bf1b1e6ee7d"}
Jul 08 04:31:56.492244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:56.492081    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:31:56.492244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:56.492104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s" event={"ID":"34b207c4-5b64-4cdd-bc7d-ae682ee36797","Type":"ContainerStarted","Data":"027d4eaaed8d8fd5b18f1b4868cd2e0659e4f83c68a07da6f4b2b60b941f522e"}
Jul 08 04:31:56.507510 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:31:56.507456    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s" podStartSLOduration=1.024124614 podStartE2EDuration="1.507441771s" totalImagesPullingTime="483.317157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:31:56.505317375 +0000 UTC m=+807.425945838" watchObservedRunningTime="2026-07-08 04:31:56.507441771 +0000 UTC m=+807.428070243"
Jul 08 04:32:07.502481 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:07.502443    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55c7f6b5f9-nhq5s"
Jul 08 04:32:19.906854 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:19.906823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:20.008174 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:20.008143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:35.701340 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:35.701308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:35.804222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:35.804188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:35.913660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:35.913623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:41.703072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:41.703039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:41.761185 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:41.761150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:41.832870 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:41.832829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:41.933632 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:41.933590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:42.052994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:42.052968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:47.646217 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:47.646174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:32:47.718446 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:32:47.718398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:33:08.193272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:33:08.193232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:33:29.571059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:33:29.570975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:33:29.572961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:33:29.572938    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:36:03.252107 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:36:03.252070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:36:03.340064 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:36:03.340012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:38:04.205383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:38:04.205351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:38:29.602910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:38:29.602878    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:38:29.606145 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:38:29.606122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:40:39.672390 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:40:39.672339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:40:40.944784 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:40:40.944746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:41:21.193526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:41:21.193487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:42:32.341528 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:42:32.341444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:42:32.440897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:42:32.440849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:42:52.699096 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:42:52.699059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:43:29.636207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:43:29.636178    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:43:29.639544 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:43:29.639522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:43:39.702126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:43:39.702087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:43:47.545678 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:43:47.545644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:43:55.828222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:43:55.828126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:01.605408 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:01.605371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:04.604707 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:04.604663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:04.700943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:04.700909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:05.046226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:05.046195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:10.645669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.645632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:10.747755 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.747716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:10.816413 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.816376    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:10.820224 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.819956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.823890 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.823846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1aed30c8-openshift-default-dockercfg-ppbp2\""
Jul 08 04:44:10.851788 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.851750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:10.855232 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855397 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855397 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855397 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7xjc\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.855654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.855543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.862575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.862549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:10.957082 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.956982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957082 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957082 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7xjc\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957551    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.957994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.957978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.959440 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.959420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.959558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.959544    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.975420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.975382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7xjc\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:10.997251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:10.997214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token\") pod \"e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") " pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:11.001515 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.001492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:11.131474 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.131439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:11.267966 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.267880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:11.270735 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:11.270693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9415ad_cc0d_4482_b9bd_33a79a4fde32.slice/crio-faad7f1c00c6eec2d1588e40e692a61f9ab6e3f87884269d19576345984a5b16 WatchSource:0}: Error finding container faad7f1c00c6eec2d1588e40e692a61f9ab6e3f87884269d19576345984a5b16: Status 404 returned error can't find the container with id faad7f1c00c6eec2d1588e40e692a61f9ab6e3f87884269d19576345984a5b16
Jul 08 04:44:11.272771 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.272742    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:11.272836 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.272810    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:11.272901 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:11.272838    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:12.050035 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.049998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:12.122814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.122773    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:12.126948 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.126926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.129763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.129738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1aed30c8-serving-cert\""
Jul 08 04:44:12.136167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.136138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:12.140123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.140094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:12.174244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.174203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69zl6\" (UniqueName: \"kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.174437 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.174265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.174437 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.174395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.208170 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.208135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:12.235402 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.235359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" event={"ID":"4b9415ad-cc0d-4482-b9bd-33a79a4fde32","Type":"ContainerStarted","Data":"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"}
Jul 08 04:44:12.235574 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.235420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" event={"ID":"4b9415ad-cc0d-4482-b9bd-33a79a4fde32","Type":"ContainerStarted","Data":"faad7f1c00c6eec2d1588e40e692a61f9ab6e3f87884269d19576345984a5b16"}
Jul 08 04:44:12.267107 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.267058    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" podStartSLOduration=2.267040236 podStartE2EDuration="2.267040236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:12.265993749 +0000 UTC m=+1543.186622246" watchObservedRunningTime="2026-07-08 04:44:12.267040236 +0000 UTC m=+1543.187668709"
Jul 08 04:44:12.275532 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.275496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.275686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.275655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69zl6\" (UniqueName: \"kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.275803 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.275782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.276233 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.276210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.278214 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.278191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.284507 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.284481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69zl6\" (UniqueName: \"kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6\") pod \"maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.309736 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.309652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:12.440413 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.440373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:12.579094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.579000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:12.582037 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:12.582010    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca0dd01_7cfb_46a7_be29_905392f75f92.slice/crio-0f388ab1f959d89f4982e0dee2aa1f8e23e850937457c2b997dd7e73bdba9dee WatchSource:0}: Error finding container 0f388ab1f959d89f4982e0dee2aa1f8e23e850937457c2b997dd7e73bdba9dee: Status 404 returned error can't find the container with id 0f388ab1f959d89f4982e0dee2aa1f8e23e850937457c2b997dd7e73bdba9dee
Jul 08 04:44:12.583482 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.583460    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:44:12.610940 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.610891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:12.711108 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:12.711066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:13.131821 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.131782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:13.136689 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.136665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:13.243513 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.243482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" event={"ID":"bca0dd01-7cfb-46a7-be29-905392f75f92","Type":"ContainerStarted","Data":"ec1fbe6f87c9d7df443799013373f0ca8ee05b81b20ce6315b904f88782ee257"}
Jul 08 04:44:13.243693 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.243533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" event={"ID":"bca0dd01-7cfb-46a7-be29-905392f75f92","Type":"ContainerStarted","Data":"0f388ab1f959d89f4982e0dee2aa1f8e23e850937457c2b997dd7e73bdba9dee"}
Jul 08 04:44:13.243815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.243797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:13.243903 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.243837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:13.244733 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.244718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:13.260135 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:13.260089    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" podStartSLOduration=0.739829263 podStartE2EDuration="1.260072046s" totalImagesPullingTime="520.242783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:13.258968392 +0000 UTC m=+1544.179596884" watchObservedRunningTime="2026-07-08 04:44:13.260072046 +0000 UTC m=+1544.180700518"
Jul 08 04:44:14.813360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:14.813327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:19.257913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:19.257871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:20.045480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.045442    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:20.045999 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.045965    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" podUID="bca0dd01-7cfb-46a7-be29-905392f75f92" containerName="maas-api" containerID="cri-o://ec1fbe6f87c9d7df443799013373f0ca8ee05b81b20ce6315b904f88782ee257" gracePeriod=30
Jul 08 04:44:20.074536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.074502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:20.171477 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.171450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:20.282137 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.282102    2562 generic.go:356] "Generic (PLEG): container finished" podID="bca0dd01-7cfb-46a7-be29-905392f75f92" containerID="ec1fbe6f87c9d7df443799013373f0ca8ee05b81b20ce6315b904f88782ee257" exitCode=0
Jul 08 04:44:20.282530 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.282214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" event={"ID":"bca0dd01-7cfb-46a7-be29-905392f75f92","Type":"ContainerDied","Data":"ec1fbe6f87c9d7df443799013373f0ca8ee05b81b20ce6315b904f88782ee257"}
Jul 08 04:44:20.316629 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.316598    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:20.316823 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.316797    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" podUID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" containerName="istio-proxy" containerID="cri-o://a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4" gracePeriod=30
Jul 08 04:44:20.326512 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.326486    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:20.350885 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.350074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:20.456746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.456675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:20.459706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.459685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca\") pod \"bca0dd01-7cfb-46a7-be29-905392f75f92\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") "
Jul 08 04:44:20.459814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.459733    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls\") pod \"bca0dd01-7cfb-46a7-be29-905392f75f92\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") "
Jul 08 04:44:20.459814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.459789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69zl6\" (UniqueName: \"kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6\") pod \"bca0dd01-7cfb-46a7-be29-905392f75f92\" (UID: \"bca0dd01-7cfb-46a7-be29-905392f75f92\") "
Jul 08 04:44:20.460217 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.460182    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bca0dd01-7cfb-46a7-be29-905392f75f92" (UID: "bca0dd01-7cfb-46a7-be29-905392f75f92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:20.462384 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.462029    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6" (OuterVolumeSpecName: "kube-api-access-69zl6") pod "bca0dd01-7cfb-46a7-be29-905392f75f92" (UID: "bca0dd01-7cfb-46a7-be29-905392f75f92"). InnerVolumeSpecName "kube-api-access-69zl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:20.462384 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.462318    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bca0dd01-7cfb-46a7-be29-905392f75f92" (UID: "bca0dd01-7cfb-46a7-be29-905392f75f92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:44:20.560570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.560479    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69zl6\" (UniqueName: \"kubernetes.io/projected/bca0dd01-7cfb-46a7-be29-905392f75f92-kube-api-access-69zl6\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:20.560570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.560511    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca0dd01-7cfb-46a7-be29-905392f75f92-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:20.560570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:20.560521    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca0dd01-7cfb-46a7-be29-905392f75f92-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:21.290848 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.290821    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"
Jul 08 04:44:21.290848 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.290835    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb" event={"ID":"bca0dd01-7cfb-46a7-be29-905392f75f92","Type":"ContainerDied","Data":"0f388ab1f959d89f4982e0dee2aa1f8e23e850937457c2b997dd7e73bdba9dee"}
Jul 08 04:44:21.291361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.290909    2562 scope.go:117] "RemoveContainer" containerID="ec1fbe6f87c9d7df443799013373f0ca8ee05b81b20ce6315b904f88782ee257"
Jul 08 04:44:21.316671 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.316636    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:21.320605 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.320576    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1aed30c8-7944886c94-mmsxb"]
Jul 08 04:44:21.737912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:21.737845    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca0dd01-7cfb-46a7-be29-905392f75f92" path="/var/lib/kubelet/pods/bca0dd01-7cfb-46a7-be29-905392f75f92/volumes"
Jul 08 04:44:22.224822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:22.224791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:23.969216 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:23.969190    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:24.088311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088265    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088324    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088517    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088565    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088566    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:24.088698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088603    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7xjc\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert\") pod \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\" (UID: \"4b9415ad-cc0d-4482-b9bd-33a79a4fde32\") "
Jul 08 04:44:24.088698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088668    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:24.089000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088957    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.089000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.088976    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.089187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.089008    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:24.089187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.089101    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:24.089359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.089337    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:24.090730 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.090706    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:24.090917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.090896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc" (OuterVolumeSpecName: "kube-api-access-p7xjc") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "kube-api-access-p7xjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:24.091018 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.091002    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:24.091067 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.091055    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b9415ad-cc0d-4482-b9bd-33a79a4fde32" (UID: "4b9415ad-cc0d-4482-b9bd-33a79a4fde32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:44:24.190294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190260    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190288    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190298    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7xjc\" (UniqueName: \"kubernetes.io/projected/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-kube-api-access-p7xjc\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190310    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190318    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190326    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.190526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.190333    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9415ad-cc0d-4482-b9bd-33a79a4fde32-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:24.313469 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.313431    2562 generic.go:356] "Generic (PLEG): container finished" podID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" containerID="a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4" exitCode=0
Jul 08 04:44:24.313655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.313482    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"
Jul 08 04:44:24.313655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.313483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" event={"ID":"4b9415ad-cc0d-4482-b9bd-33a79a4fde32","Type":"ContainerDied","Data":"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"}
Jul 08 04:44:24.313655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.313538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4" event={"ID":"4b9415ad-cc0d-4482-b9bd-33a79a4fde32","Type":"ContainerDied","Data":"faad7f1c00c6eec2d1588e40e692a61f9ab6e3f87884269d19576345984a5b16"}
Jul 08 04:44:24.313655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.313567    2562 scope.go:117] "RemoveContainer" containerID="a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"
Jul 08 04:44:24.323711 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.323692    2562 scope.go:117] "RemoveContainer" containerID="a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"
Jul 08 04:44:24.324026 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:24.323999    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4\": container with ID starting with a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4 not found: ID does not exist" containerID="a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"
Jul 08 04:44:24.324140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.324034    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4"} err="failed to get container status \"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4\": rpc error: code = NotFound desc = could not find container \"a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4\": container with ID starting with a0535b8626f71e8b98c66ffb570ca0d996dce3d0af25662ed728644b1e8026c4 not found: ID does not exist"
Jul 08 04:44:24.336924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.336889    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:24.341036 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:24.340953    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1aed30c8-openshift-default-6f7984fb8f-nqnz4"]
Jul 08 04:44:25.729135 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:25.729101    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" path="/var/lib/kubelet/pods/4b9415ad-cc0d-4482-b9bd-33a79a4fde32/volumes"
Jul 08 04:44:26.039341 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.039259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:26.101223 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.101187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:26.221498 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.221463    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:26.222049 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222026    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca0dd01-7cfb-46a7-be29-905392f75f92" containerName="maas-api"
Jul 08 04:44:26.222175 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222159    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca0dd01-7cfb-46a7-be29-905392f75f92" containerName="maas-api"
Jul 08 04:44:26.222237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222192    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" containerName="istio-proxy"
Jul 08 04:44:26.222237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222201    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" containerName="istio-proxy"
Jul 08 04:44:26.222335 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222322    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9415ad-cc0d-4482-b9bd-33a79a4fde32" containerName="istio-proxy"
Jul 08 04:44:26.222383 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.222342    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca0dd01-7cfb-46a7-be29-905392f75f92" containerName="maas-api"
Jul 08 04:44:26.226801 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.226777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.230110 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.230085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-75cc02b2-openshift-default-dockercfg-j55zt\""
Jul 08 04:44:26.241452 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.241419    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:26.263737 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.263703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:26.308941 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.308820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.308941 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.308892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.308941 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.308917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.308941 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.308940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sprgx\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.309205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.308969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.309205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.309027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.309205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.309095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.309205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.309127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.309205 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.309145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.362706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.362659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:26.410123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410388 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410436 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410499 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410606 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410648    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410749 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sprgx\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410801 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410749    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.410943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.410925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.411042 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.411023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.412665 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.412637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.412763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.412689    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.418714 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.418686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.418820 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.418757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sprgx\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx\") pod \"e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") " pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.543069 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.543029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:26.685473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.685441    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:26.686697 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:26.686666    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903929d3_0afb_4a72_9a81_17d7c1639680.slice/crio-1e59022a5315d8859dcc3bbc6f4a0fe18cdbf92426a3242542219e2e227e3304 WatchSource:0}: Error finding container 1e59022a5315d8859dcc3bbc6f4a0fe18cdbf92426a3242542219e2e227e3304: Status 404 returned error can't find the container with id 1e59022a5315d8859dcc3bbc6f4a0fe18cdbf92426a3242542219e2e227e3304
Jul 08 04:44:26.688688 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.688653    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:26.688758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.688721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:26.688791 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:26.688752    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:27.332664 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.332613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" event={"ID":"903929d3-0afb-4a72-9a81-17d7c1639680","Type":"ContainerStarted","Data":"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"}
Jul 08 04:44:27.333113 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.332691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" event={"ID":"903929d3-0afb-4a72-9a81-17d7c1639680","Type":"ContainerStarted","Data":"1e59022a5315d8859dcc3bbc6f4a0fe18cdbf92426a3242542219e2e227e3304"}
Jul 08 04:44:27.354808 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.354752    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" podStartSLOduration=1.354734461 podStartE2EDuration="1.354734461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:27.352962351 +0000 UTC m=+1558.273590849" watchObservedRunningTime="2026-07-08 04:44:27.354734461 +0000 UTC m=+1558.275362932"
Jul 08 04:44:27.432942 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.432886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:27.530254 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.530219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:27.531685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.531656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:27.534017 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.533997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.537159 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.537138    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-75cc02b2-serving-cert\""
Jul 08 04:44:27.543690 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.543668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:27.548571 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.548549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:27.557975 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.557940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:27.621763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.621673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.621763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.621714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.621763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.621739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjkch\" (UniqueName: \"kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.667057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.667021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:27.723225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.723184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.723442 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.723234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.723442 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.723269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjkch\" (UniqueName: \"kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.723442 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:27.723399    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-serving-cert: secret "maas-api-e2e-ait-75cc02b2-serving-cert" not found
Jul 08 04:44:27.723620 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:27.723475    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls podName:4b6839af-604e-40ad-8d34-23915d597581 nodeName:}" failed. No retries permitted until 2026-07-08 04:44:28.223454462 +0000 UTC m=+1559.144082917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls") pod "maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" (UID: "4b6839af-604e-40ad-8d34-23915d597581") : secret "maas-api-e2e-ait-75cc02b2-serving-cert" not found
Jul 08 04:44:27.723919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.723898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.732870 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.732824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjkch\" (UniqueName: \"kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:27.915589 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:27.915498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:28.139289 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.139253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:28.227111 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.227077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:28.229720 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.229692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") pod \"maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:28.239165 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.239139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:28.337935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.337901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:28.338923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.338893    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:28.444385 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.444346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:28.587996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:28.587972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:28.589922 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:28.589848    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6839af_604e_40ad_8d34_23915d597581.slice/crio-5e789bf495f04d8d25f1cf9ae2570eb1cede10437c503e0b581da9cabc2a3953 WatchSource:0}: Error finding container 5e789bf495f04d8d25f1cf9ae2570eb1cede10437c503e0b581da9cabc2a3953: Status 404 returned error can't find the container with id 5e789bf495f04d8d25f1cf9ae2570eb1cede10437c503e0b581da9cabc2a3953
Jul 08 04:44:29.344790 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:29.344690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" event={"ID":"4b6839af-604e-40ad-8d34-23915d597581","Type":"ContainerStarted","Data":"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"}
Jul 08 04:44:29.344790 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:29.344746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" event={"ID":"4b6839af-604e-40ad-8d34-23915d597581","Type":"ContainerStarted","Data":"5e789bf495f04d8d25f1cf9ae2570eb1cede10437c503e0b581da9cabc2a3953"}
Jul 08 04:44:29.344790 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:29.344775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:29.364692 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:29.364629    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" podStartSLOduration=1.92871651 podStartE2EDuration="2.364603985s" totalImagesPullingTime="435.887475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:29.362578553 +0000 UTC m=+1560.283207026" watchObservedRunningTime="2026-07-08 04:44:29.364603985 +0000 UTC m=+1560.285232458"
Jul 08 04:44:29.662466 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:29.662424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:35.356287 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.356256    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:35.467326 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.467230    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:35.467518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.467448    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" podUID="4b6839af-604e-40ad-8d34-23915d597581" containerName="maas-api" containerID="cri-o://5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7" gracePeriod=30
Jul 08 04:44:35.494201 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:35.494171    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-serving-cert: secret "maas-api-e2e-ait-75cc02b2-serving-cert" not found
Jul 08 04:44:35.494375 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:35.494244    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls podName:4b6839af-604e-40ad-8d34-23915d597581 nodeName:}" failed. No retries permitted until 2026-07-08 04:44:35.994224039 +0000 UTC m=+1566.914852506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls") pod "maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" (UID: "4b6839af-604e-40ad-8d34-23915d597581") : secret "maas-api-e2e-ait-75cc02b2-serving-cert" not found
Jul 08 04:44:35.495041 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.495017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:35.552979 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.552947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:35.737661 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.737637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:35.897983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.897945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca\") pod \"4b6839af-604e-40ad-8d34-23915d597581\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") "
Jul 08 04:44:35.898161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.898008    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjkch\" (UniqueName: \"kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch\") pod \"4b6839af-604e-40ad-8d34-23915d597581\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") "
Jul 08 04:44:35.898161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.898072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") pod \"4b6839af-604e-40ad-8d34-23915d597581\" (UID: \"4b6839af-604e-40ad-8d34-23915d597581\") "
Jul 08 04:44:35.898407 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.898377    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b6839af-604e-40ad-8d34-23915d597581" (UID: "4b6839af-604e-40ad-8d34-23915d597581"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:35.902074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.899184    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6839af-604e-40ad-8d34-23915d597581-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:35.908410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.908364    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b6839af-604e-40ad-8d34-23915d597581" (UID: "4b6839af-604e-40ad-8d34-23915d597581"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:44:35.909105 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.909048    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch" (OuterVolumeSpecName: "kube-api-access-xjkch") pod "4b6839af-604e-40ad-8d34-23915d597581" (UID: "4b6839af-604e-40ad-8d34-23915d597581"). InnerVolumeSpecName "kube-api-access-xjkch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:35.999694 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.999648    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b6839af-604e-40ad-8d34-23915d597581-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:35.999694 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:35.999684    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjkch\" (UniqueName: \"kubernetes.io/projected/4b6839af-604e-40ad-8d34-23915d597581-kube-api-access-xjkch\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:36.386529 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.386435    2562 generic.go:356] "Generic (PLEG): container finished" podID="4b6839af-604e-40ad-8d34-23915d597581" containerID="5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7" exitCode=0
Jul 08 04:44:36.386529 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.386500    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"
Jul 08 04:44:36.387074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.386530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" event={"ID":"4b6839af-604e-40ad-8d34-23915d597581","Type":"ContainerDied","Data":"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"}
Jul 08 04:44:36.387074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.386620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6" event={"ID":"4b6839af-604e-40ad-8d34-23915d597581","Type":"ContainerDied","Data":"5e789bf495f04d8d25f1cf9ae2570eb1cede10437c503e0b581da9cabc2a3953"}
Jul 08 04:44:36.387074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.386649    2562 scope.go:117] "RemoveContainer" containerID="5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"
Jul 08 04:44:36.396821 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.396803    2562 scope.go:117] "RemoveContainer" containerID="5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"
Jul 08 04:44:36.397170 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:36.397150    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7\": container with ID starting with 5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7 not found: ID does not exist" containerID="5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"
Jul 08 04:44:36.397240 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.397180    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7"} err="failed to get container status \"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7\": rpc error: code = NotFound desc = could not find container \"5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7\": container with ID starting with 5296636db100b5335ea20d1eafc0a9b7bada70ee5c227ae212d3fb3136d961e7 not found: ID does not exist"
Jul 08 04:44:36.411966 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.411925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:36.415675 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.415644    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75cc02b2-f49d7c88c-q9nt6"]
Jul 08 04:44:36.446032 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.445988    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:36.446281 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.446256    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" podUID="903929d3-0afb-4a72-9a81-17d7c1639680" containerName="istio-proxy" containerID="cri-o://ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6" gracePeriod=30
Jul 08 04:44:36.470873 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.470836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:36.570380 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:36.570347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:37.731556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:37.731521    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6839af-604e-40ad-8d34-23915d597581" path="/var/lib/kubelet/pods/4b6839af-604e-40ad-8d34-23915d597581/volumes"
Jul 08 04:44:38.103527 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.103499    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:38.220396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220470    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220531    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sprgx\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220570    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert\") pod \"903929d3-0afb-4a72-9a81-17d7c1639680\" (UID: \"903929d3-0afb-4a72-9a81-17d7c1639680\") "
Jul 08 04:44:38.220935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220721    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:38.220935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220819    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:38.221140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.220998    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:38.221140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.221019    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.221140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.221068    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.221253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.221160    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:38.221568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.221545    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data" (OuterVolumeSpecName: "istio-data") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:38.223169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.223139    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:44:38.223271 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.223212    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx" (OuterVolumeSpecName: "kube-api-access-sprgx") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "kube-api-access-sprgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:38.223271 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.223232    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token" (OuterVolumeSpecName: "istio-token") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:38.223394 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.223376    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "903929d3-0afb-4a72-9a81-17d7c1639680" (UID: "903929d3-0afb-4a72-9a81-17d7c1639680"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321833    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sprgx\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-kube-api-access-sprgx\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321906    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321919    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321927    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/903929d3-0afb-4a72-9a81-17d7c1639680-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321936    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/903929d3-0afb-4a72-9a81-17d7c1639680-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.321938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321944    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/903929d3-0afb-4a72-9a81-17d7c1639680-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.322246 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.321951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/903929d3-0afb-4a72-9a81-17d7c1639680-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:38.399906 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.399873    2562 generic.go:356] "Generic (PLEG): container finished" podID="903929d3-0afb-4a72-9a81-17d7c1639680" containerID="ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6" exitCode=0
Jul 08 04:44:38.400080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.399917    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"
Jul 08 04:44:38.400080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.399946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" event={"ID":"903929d3-0afb-4a72-9a81-17d7c1639680","Type":"ContainerDied","Data":"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"}
Jul 08 04:44:38.400080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.399994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw" event={"ID":"903929d3-0afb-4a72-9a81-17d7c1639680","Type":"ContainerDied","Data":"1e59022a5315d8859dcc3bbc6f4a0fe18cdbf92426a3242542219e2e227e3304"}
Jul 08 04:44:38.400080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.400016    2562 scope.go:117] "RemoveContainer" containerID="ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"
Jul 08 04:44:38.409202 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.409184    2562 scope.go:117] "RemoveContainer" containerID="ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"
Jul 08 04:44:38.409493 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:44:38.409475    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6\": container with ID starting with ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6 not found: ID does not exist" containerID="ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"
Jul 08 04:44:38.409571 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.409501    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6"} err="failed to get container status \"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6\": rpc error: code = NotFound desc = could not find container \"ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6\": container with ID starting with ba710f74353e9bf5cbd39cb5c41cf9b4085de42d4284ce6fcf2c4a5816cfc3e6 not found: ID does not exist"
Jul 08 04:44:38.421720 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.421687    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:38.426649 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:38.426623    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-75cc02b2-openshift-default-7dfdffbd87-fwjqw"]
Jul 08 04:44:39.728683 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:39.728643    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903929d3-0afb-4a72-9a81-17d7c1639680" path="/var/lib/kubelet/pods/903929d3-0afb-4a72-9a81-17d7c1639680/volumes"
Jul 08 04:44:40.657434 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:40.634831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:42.485321 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.485277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:42.587211 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.587173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:42.666420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666388    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:42.666762 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666750    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6839af-604e-40ad-8d34-23915d597581" containerName="maas-api"
Jul 08 04:44:42.666813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666764    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6839af-604e-40ad-8d34-23915d597581" containerName="maas-api"
Jul 08 04:44:42.666813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666775    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903929d3-0afb-4a72-9a81-17d7c1639680" containerName="istio-proxy"
Jul 08 04:44:42.666813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666780    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="903929d3-0afb-4a72-9a81-17d7c1639680" containerName="istio-proxy"
Jul 08 04:44:42.666925 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666839    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="903929d3-0afb-4a72-9a81-17d7c1639680" containerName="istio-proxy"
Jul 08 04:44:42.666925 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.666851    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6839af-604e-40ad-8d34-23915d597581" containerName="maas-api"
Jul 08 04:44:42.670016 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.669997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.672806 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.672781    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d0aa5ff7-openshift-default-dockercfg-f58jd\""
Jul 08 04:44:42.682165 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.682138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:42.696349 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.696314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:42.797111 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.797027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:42.865259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5vq\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.865646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.865562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966446 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966446 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966672 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966672 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966672 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966829 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966938    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5vq\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.966993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.966955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.967135 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.967016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.967135 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.967031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.967227 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.967139    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.967489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.967470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.968785 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.968764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.968910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.968893    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.979088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.979059    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.979197 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.979163    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5vq\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq\") pod \"e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") " pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:42.984021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:42.984003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:43.120769 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.120742    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:43.122396 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:43.122372    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d59d1a4_f513_4bcd_9cd5_d6538f7d28a2.slice/crio-8261a6a02e04acc6a25249dd6a4cd9734705c926d0b79ec26b3dd8e69e027265 WatchSource:0}: Error finding container 8261a6a02e04acc6a25249dd6a4cd9734705c926d0b79ec26b3dd8e69e027265: Status 404 returned error can't find the container with id 8261a6a02e04acc6a25249dd6a4cd9734705c926d0b79ec26b3dd8e69e027265
Jul 08 04:44:43.124473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.124436    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:43.124579 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.124505    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:43.124579 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.124556    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:44:43.427668 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.427577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" event={"ID":"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2","Type":"ContainerStarted","Data":"e33e7fa7d4fe519d31e23870b25a1269b4fe8e16b6c22ecf270322a0fe405128"}
Jul 08 04:44:43.427668 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.427633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" event={"ID":"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2","Type":"ContainerStarted","Data":"8261a6a02e04acc6a25249dd6a4cd9734705c926d0b79ec26b3dd8e69e027265"}
Jul 08 04:44:43.451300 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.451248    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" podStartSLOduration=1.451230936 podStartE2EDuration="1.451230936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:43.449371788 +0000 UTC m=+1574.370000260" watchObservedRunningTime="2026-07-08 04:44:43.451230936 +0000 UTC m=+1574.371859493"
Jul 08 04:44:43.891919 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.891885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:43.967007 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.966976    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:43.973457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.973416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:43.977151 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.977127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:43.979768 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.979747    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d0aa5ff7-serving-cert\""
Jul 08 04:44:43.981675 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.981651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:43.984166 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:43.984125    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:44.047832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.047791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:44.076989 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.076956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.077163 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.077024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vsc\" (UniqueName: \"kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.077163 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.077129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.147712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.147615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:44.178604 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.178563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.178815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.178636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vsc\" (UniqueName: \"kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.178815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.178683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.179346 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.179320    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.181214 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.181194    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.188014 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.187989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vsc\" (UniqueName: \"kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc\") pod \"maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.290170 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.290135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:44.425550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.425522    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:44.427666 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:44:44.427639    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b45c2f5_2cea_4370_b495_555a65352920.slice/crio-d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704 WatchSource:0}: Error finding container d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704: Status 404 returned error can't find the container with id d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704
Jul 08 04:44:44.556459 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.556421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:44.658030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.657989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:44.989232 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:44.989201    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:45.444716 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.444685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" event={"ID":"9b45c2f5-2cea-4370-b495-555a65352920","Type":"ContainerStarted","Data":"b386e49c9153015e566d665a97d252fde5d673b7a869fe4b96bfc868b25d4fd9"}
Jul 08 04:44:45.444913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.444736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" event={"ID":"9b45c2f5-2cea-4370-b495-555a65352920","Type":"ContainerStarted","Data":"d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704"}
Jul 08 04:44:45.444913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.444758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:45.445155 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.445135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:45.446100 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.446083    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:45.461772 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:45.461715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" podStartSLOduration=2.02894305 podStartE2EDuration="2.461694946s" totalImagesPullingTime="432.751896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:44:45.460793506 +0000 UTC m=+1576.381422010" watchObservedRunningTime="2026-07-08 04:44:45.461694946 +0000 UTC m=+1576.382323419"
Jul 08 04:44:46.570085 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:46.570052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:51.216022 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.215987    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:51.216489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.216263    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" podUID="9b45c2f5-2cea-4370-b495-555a65352920" containerName="maas-api" containerID="cri-o://b386e49c9153015e566d665a97d252fde5d673b7a869fe4b96bfc868b25d4fd9" gracePeriod=30
Jul 08 04:44:51.222845 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.222820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:51.239285 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.239251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:51.339878 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.339836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:51.387545 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.387500    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:51.387963 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.387934    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" podUID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" containerName="istio-proxy" containerID="cri-o://e33e7fa7d4fe519d31e23870b25a1269b4fe8e16b6c22ecf270322a0fe405128" gracePeriod=30
Jul 08 04:44:51.412471 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.412435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:51.485293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.484028    2562 generic.go:356] "Generic (PLEG): container finished" podID="9b45c2f5-2cea-4370-b495-555a65352920" containerID="b386e49c9153015e566d665a97d252fde5d673b7a869fe4b96bfc868b25d4fd9" exitCode=0
Jul 08 04:44:51.485293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.484084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" event={"ID":"9b45c2f5-2cea-4370-b495-555a65352920","Type":"ContainerDied","Data":"b386e49c9153015e566d665a97d252fde5d673b7a869fe4b96bfc868b25d4fd9"}
Jul 08 04:44:51.485293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.484168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb" event={"ID":"9b45c2f5-2cea-4370-b495-555a65352920","Type":"ContainerDied","Data":"d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704"}
Jul 08 04:44:51.485293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.484190    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6d2d944397269f00090a3c56ff6030e4c8871ef39b5b7c90238fd9526d04704"
Jul 08 04:44:51.486147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.486120    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:51.508553 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.508518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:51.546277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.545228    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls\") pod \"9b45c2f5-2cea-4370-b495-555a65352920\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") "
Jul 08 04:44:51.546277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.545294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7vsc\" (UniqueName: \"kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc\") pod \"9b45c2f5-2cea-4370-b495-555a65352920\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") "
Jul 08 04:44:51.546277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.545325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca\") pod \"9b45c2f5-2cea-4370-b495-555a65352920\" (UID: \"9b45c2f5-2cea-4370-b495-555a65352920\") "
Jul 08 04:44:51.546277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.545964    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b45c2f5-2cea-4370-b495-555a65352920" (UID: "9b45c2f5-2cea-4370-b495-555a65352920"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:51.559196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.559009    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b45c2f5-2cea-4370-b495-555a65352920" (UID: "9b45c2f5-2cea-4370-b495-555a65352920"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:44:51.559608 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.559571    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc" (OuterVolumeSpecName: "kube-api-access-z7vsc") pod "9b45c2f5-2cea-4370-b495-555a65352920" (UID: "9b45c2f5-2cea-4370-b495-555a65352920"). InnerVolumeSpecName "kube-api-access-z7vsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:51.646674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.646625    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b45c2f5-2cea-4370-b495-555a65352920-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:51.646674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.646674    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7vsc\" (UniqueName: \"kubernetes.io/projected/9b45c2f5-2cea-4370-b495-555a65352920-kube-api-access-z7vsc\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:51.646976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:51.646689    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b45c2f5-2cea-4370-b495-555a65352920-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:52.488981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:52.488949    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"
Jul 08 04:44:52.516037 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:52.515999    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:52.534294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:52.534253    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d0aa5ff7-7b95d8fcfb-ntjfb"]
Jul 08 04:44:53.057248 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:53.057203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:53.728852 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:53.728819    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b45c2f5-2cea-4370-b495-555a65352920" path="/var/lib/kubelet/pods/9b45c2f5-2cea-4370-b495-555a65352920/volumes"
Jul 08 04:44:56.513030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.512990    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" containerID="e33e7fa7d4fe519d31e23870b25a1269b4fe8e16b6c22ecf270322a0fe405128" exitCode=0
Jul 08 04:44:56.513374 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.513077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" event={"ID":"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2","Type":"ContainerDied","Data":"e33e7fa7d4fe519d31e23870b25a1269b4fe8e16b6c22ecf270322a0fe405128"}
Jul 08 04:44:56.652703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.652620    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:56.701703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.701703 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701707    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701740    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701826    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701901    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj5vq\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701929    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.701972    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702019    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data\") pod \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\" (UID: \"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2\") "
Jul 08 04:44:56.702379 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702051    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:56.702379 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702178    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:56.702491 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702380    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.702491 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702401    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.702611 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702588    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:56.702963 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702802    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:44:56.703105 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.702991    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:56.704433 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.704406    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:56.704623 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.704593    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:44:56.704960 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.704936    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:44:56.705413 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.705393    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq" (OuterVolumeSpecName: "kube-api-access-qj5vq") pod "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" (UID: "3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2"). InnerVolumeSpecName "kube-api-access-qj5vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:44:56.802993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.802954    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.802993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.802986    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.802993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.802996    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj5vq\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-kube-api-access-qj5vq\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.802993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.803005    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.803259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.803014    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.803259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.803022    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:56.803259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:56.803029    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:44:57.196319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.196284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:57.298123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.298084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:57.519977 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.519949    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"
Jul 08 04:44:57.519977 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.519957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885" event={"ID":"3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2","Type":"ContainerDied","Data":"8261a6a02e04acc6a25249dd6a4cd9734705c926d0b79ec26b3dd8e69e027265"}
Jul 08 04:44:57.520566 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.520011    2562 scope.go:117] "RemoveContainer" containerID="e33e7fa7d4fe519d31e23870b25a1269b4fe8e16b6c22ecf270322a0fe405128"
Jul 08 04:44:57.542431 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.542399    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:57.547027 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.546988    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d0aa5ff7-openshift-default-68b56c7dc9-n6885"]
Jul 08 04:44:57.647767 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.647729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:57.728118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.728087    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" path="/var/lib/kubelet/pods/3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2/volumes"
Jul 08 04:44:57.746916 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.746820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:44:57.846464 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:44:57.846433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:29.150706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:29.150672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:34.822659 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:34.822620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:40.427013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:40.426977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:40.482922 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:40.482886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:40.561237 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:40.561206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:40.660043 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:40.660008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:40.761211 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:40.761176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:45:41.186077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:45:41.185964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:07.135458 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:07.135416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:12.775177 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:12.775150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:12.875952 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:12.875901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:12.976559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:12.976522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:28.893653 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:28.893618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:34.576413 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:34.576380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:34.680492 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:34.680461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:34.776026 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:34.775995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:45.307973 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:45.307937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:46.111619 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:46.111574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:51.911339 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:51.911245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:52.015832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:52.015795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:52.111411 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:52.111377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:52.211490 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:52.211416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:52.938150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:52.938117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:53.034971 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:53.034939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:46:53.137940 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:46:53.137886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:18.156822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:18.156788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:18.247981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:18.247947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:24.627429 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:24.627395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:28.751371 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:28.751328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:28.852107 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:28.852073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:30.684174 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:30.684140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:30.742854 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:30.742816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:36.622061 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:36.622030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:47:36.733306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:47:36.733272    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:07.248626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:07.248591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:13.846081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:13.846050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:19.393150 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.393121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:19.493697 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.493648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:19.641851 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.641818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:19.940683 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.940649    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:19.941022 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941008    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b45c2f5-2cea-4370-b495-555a65352920" containerName="maas-api"
Jul 08 04:48:19.941078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941024    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b45c2f5-2cea-4370-b495-555a65352920" containerName="maas-api"
Jul 08 04:48:19.941078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941035    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" containerName="istio-proxy"
Jul 08 04:48:19.941078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941040    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" containerName="istio-proxy"
Jul 08 04:48:19.941168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941105    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d59d1a4-f513-4bcd-9cd5-d6538f7d28a2" containerName="istio-proxy"
Jul 08 04:48:19.941168 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.941114    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b45c2f5-2cea-4370-b495-555a65352920" containerName="maas-api"
Jul 08 04:48:19.944040 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.944024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.946756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.946740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-391befc5-openshift-default-dockercfg-vbrpk\""
Jul 08 04:48:19.966474 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.966447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:19.967627 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.967602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:19.995581 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995581 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995989 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbzf\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:19.995989 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:19.995892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097506 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097506 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097506 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbzf\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097649    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097763 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097736    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.097939 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.097817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.098034 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.098013    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.099591 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.099570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.099816 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.099798    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.105911 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.105882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbzf\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.106013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.105930    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token\") pod \"e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") " pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.253923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.253885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:20.398293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.398256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:20.400136 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:48:20.400097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066c4ec3_e253_4cda_895d_1e01e83e56c1.slice/crio-ac9216a8a2c05551fd7dfa1f0e3a22983270471c58713dde74ae38636d3f4fe7 WatchSource:0}: Error finding container ac9216a8a2c05551fd7dfa1f0e3a22983270471c58713dde74ae38636d3f4fe7: Status 404 returned error can't find the container with id ac9216a8a2c05551fd7dfa1f0e3a22983270471c58713dde74ae38636d3f4fe7
Jul 08 04:48:20.402193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.402156    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:20.402311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.402239    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:20.402311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.402280    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:20.561870 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.561772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerStarted","Data":"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"}
Jul 08 04:48:20.561870 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.561829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerStarted","Data":"ac9216a8a2c05551fd7dfa1f0e3a22983270471c58713dde74ae38636d3f4fe7"}
Jul 08 04:48:20.577977 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.577946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:20.584459 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:20.584400    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" podStartSLOduration=1.5843833680000001 podStartE2EDuration="1.584383368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:48:20.58339585 +0000 UTC m=+1791.504024348" watchObservedRunningTime="2026-07-08 04:48:20.584383368 +0000 UTC m=+1791.505011840"
Jul 08 04:48:21.254568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:21.254484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:21.259512 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:21.259485    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:21.568134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:21.568054    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:21.569094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:21.569076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:22.765089 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.765057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:22.848535 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.848501    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:22.852033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.852012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:22.855381 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.855360    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-391befc5-serving-cert\""
Jul 08 04:48:22.866114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.866086    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:22.866503 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.866487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:22.923793 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.923753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4c8r\" (UniqueName: \"kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:22.923793 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.923800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:22.924057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.923823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:22.964039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:22.964005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:23.025198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.025098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.025198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.025139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.025452 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.025216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4c8r\" (UniqueName: \"kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.025898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.025846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.027709 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.027684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.047488 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.047448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4c8r\" (UniqueName: \"kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r\") pod \"maas-api-e2e-mt-391befc5-676f585b56-sn6d6\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.162053 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.162021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:23.324691 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.324651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:23.326118 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:48:23.326088    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03db8f5b_a676_490b_83a1_70d56f0fa478.slice/crio-939318d6fe7a90b01d5e468e30c20a7773ec8c06d3b98d0e19f98b80682a2fd7 WatchSource:0}: Error finding container 939318d6fe7a90b01d5e468e30c20a7773ec8c06d3b98d0e19f98b80682a2fd7: Status 404 returned error can't find the container with id 939318d6fe7a90b01d5e468e30c20a7773ec8c06d3b98d0e19f98b80682a2fd7
Jul 08 04:48:23.579555 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.579465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" event={"ID":"03db8f5b-a676-490b-83a1-70d56f0fa478","Type":"ContainerStarted","Data":"939318d6fe7a90b01d5e468e30c20a7773ec8c06d3b98d0e19f98b80682a2fd7"}
Jul 08 04:48:23.644163 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.644127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:23.744876 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:23.744834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:24.586466 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:24.586423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" event={"ID":"03db8f5b-a676-490b-83a1-70d56f0fa478","Type":"ContainerStarted","Data":"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"}
Jul 08 04:48:24.586850 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:24.586486    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:24.607295 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:24.607236    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" podStartSLOduration=2.166435946 podStartE2EDuration="2.607219993s" totalImagesPullingTime="440.784047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:48:24.604254474 +0000 UTC m=+1795.524882970" watchObservedRunningTime="2026-07-08 04:48:24.607219993 +0000 UTC m=+1795.527848465"
Jul 08 04:48:27.257079 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:27.257043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:27.904764 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:27.904724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:28.003597 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:28.003553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:28.318839 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:28.318803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:29.667627 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:29.667595    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:48:29.672253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:29.672232    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:48:30.598482 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:30.598452    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:34.034587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.034505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:34.104197 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.104154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:34.453808 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.453718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:34.819415 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.819266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:34.821930 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.821882    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:34.822216 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.822190    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" podUID="03db8f5b-a676-490b-83a1-70d56f0fa478" containerName="maas-api" containerID="cri-o://945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee" gracePeriod=30
Jul 08 04:48:34.914728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:34.914695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:35.067275 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.067251    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:35.135904 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.135788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls\") pod \"03db8f5b-a676-490b-83a1-70d56f0fa478\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") "
Jul 08 04:48:35.135904 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.135849    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca\") pod \"03db8f5b-a676-490b-83a1-70d56f0fa478\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") "
Jul 08 04:48:35.136157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.136015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4c8r\" (UniqueName: \"kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r\") pod \"03db8f5b-a676-490b-83a1-70d56f0fa478\" (UID: \"03db8f5b-a676-490b-83a1-70d56f0fa478\") "
Jul 08 04:48:35.136376 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.136342    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03db8f5b-a676-490b-83a1-70d56f0fa478" (UID: "03db8f5b-a676-490b-83a1-70d56f0fa478"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:48:35.138065 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.138033    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03db8f5b-a676-490b-83a1-70d56f0fa478" (UID: "03db8f5b-a676-490b-83a1-70d56f0fa478"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:48:35.138431 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.138415    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r" (OuterVolumeSpecName: "kube-api-access-z4c8r") pod "03db8f5b-a676-490b-83a1-70d56f0fa478" (UID: "03db8f5b-a676-490b-83a1-70d56f0fa478"). InnerVolumeSpecName "kube-api-access-z4c8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:48:35.237279 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.237234    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03db8f5b-a676-490b-83a1-70d56f0fa478-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:35.237279 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.237276    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03db8f5b-a676-490b-83a1-70d56f0fa478-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:35.237484 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.237294    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4c8r\" (UniqueName: \"kubernetes.io/projected/03db8f5b-a676-490b-83a1-70d56f0fa478-kube-api-access-z4c8r\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:35.650018 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.649984    2562 generic.go:356] "Generic (PLEG): container finished" podID="03db8f5b-a676-490b-83a1-70d56f0fa478" containerID="945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee" exitCode=0
Jul 08 04:48:35.650198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.650027    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"
Jul 08 04:48:35.650198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.650068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" event={"ID":"03db8f5b-a676-490b-83a1-70d56f0fa478","Type":"ContainerDied","Data":"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"}
Jul 08 04:48:35.650198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.650124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6" event={"ID":"03db8f5b-a676-490b-83a1-70d56f0fa478","Type":"ContainerDied","Data":"939318d6fe7a90b01d5e468e30c20a7773ec8c06d3b98d0e19f98b80682a2fd7"}
Jul 08 04:48:35.650198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.650149    2562 scope.go:117] "RemoveContainer" containerID="945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"
Jul 08 04:48:35.660812 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.660792    2562 scope.go:117] "RemoveContainer" containerID="945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"
Jul 08 04:48:35.661312 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:48:35.661285    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee\": container with ID starting with 945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee not found: ID does not exist" containerID="945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"
Jul 08 04:48:35.661396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.661327    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee"} err="failed to get container status \"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee\": rpc error: code = NotFound desc = could not find container \"945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee\": container with ID starting with 945aea54facc51f41a29542c4cf58c8327bc0e09b2beedcb161e7134db6eabee not found: ID does not exist"
Jul 08 04:48:35.671955 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.671926    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:35.676868 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.676825    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-391befc5-676f585b56-sn6d6"]
Jul 08 04:48:35.729123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:35.729094    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03db8f5b-a676-490b-83a1-70d56f0fa478" path="/var/lib/kubelet/pods/03db8f5b-a676-490b-83a1-70d56f0fa478/volumes"
Jul 08 04:48:36.994642 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:36.994615    2562 patch_prober.go:28] interesting pod/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:36068->10.134.0.55:15021: read: connection reset by peer" start-of-body=
Jul 08 04:48:36.995082 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:36.994938    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:36068->10.134.0.55:15021: read: connection reset by peer"
Jul 08 04:48:37.664159 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.664127    2562 generic.go:356] "Generic (PLEG): container finished" podID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerID="aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0" exitCode=0
Jul 08 04:48:37.664377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.664208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerDied","Data":"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"}
Jul 08 04:48:37.664617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.664603    2562 scope.go:117] "RemoveContainer" containerID="aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"
Jul 08 04:48:37.665626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.665596    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:37.665756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.665676    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:37.665756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:37.665723    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:48:38.670805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:38.670771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerStarted","Data":"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"}
Jul 08 04:48:39.255054 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:39.255018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:39.255462 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:39.255441    2562 patch_prober.go:28] interesting pod/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 04:48:39.255549 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:39.255488    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 04:48:40.254750 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:40.254714    2562 patch_prober.go:28] interesting pod/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 08 04:48:40.255151 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:40.254774    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 08 04:48:40.892222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:40.892190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:40.957454 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:40.957421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:41.195924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.195809    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:41.196144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.196106    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy" containerID="cri-o://e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839" gracePeriod=30
Jul 08 04:48:41.241194 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.241103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:41.539155 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.538990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:41.628075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.628047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:41.766722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:41.766689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:47.368948 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.368919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:47.474157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.474126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:47.551342 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.551320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:47.568927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.568897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:47.657031 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.656942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvbzf\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657031 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.656989    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657038    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657114    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657185    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657231    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket\") pod \"066c4ec3-e253-4cda-895d-1e01e83e56c1\" (UID: \"066c4ec3-e253-4cda-895d-1e01e83e56c1\") "
Jul 08 04:48:47.657617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657412    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:48:47.657617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657579    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.657723 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657635    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:48:47.657723 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657651    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:48:47.657723 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.657668    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:48:47.658328 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.658297    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:48:47.659370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.659337    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf" (OuterVolumeSpecName: "kube-api-access-pvbzf") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "kube-api-access-pvbzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:48:47.659490 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.659424    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:48:47.659564 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.659476    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:48:47.659614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.659564    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "066c4ec3-e253-4cda-895d-1e01e83e56c1" (UID: "066c4ec3-e253-4cda-895d-1e01e83e56c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:48:47.724655 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.724605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:47.727318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.727294    2562 generic.go:356] "Generic (PLEG): container finished" podID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerID="e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839" exitCode=0
Jul 08 04:48:47.727446 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.727393    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"
Jul 08 04:48:47.728593 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.728568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerDied","Data":"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"}
Jul 08 04:48:47.728719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.728612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf" event={"ID":"066c4ec3-e253-4cda-895d-1e01e83e56c1","Type":"ContainerDied","Data":"ac9216a8a2c05551fd7dfa1f0e3a22983270471c58713dde74ae38636d3f4fe7"}
Jul 08 04:48:47.728719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.728640    2562 scope.go:117] "RemoveContainer" containerID="e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"
Jul 08 04:48:47.738129 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.738104    2562 scope.go:117] "RemoveContainer" containerID="aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"
Jul 08 04:48:47.746405 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.746380    2562 scope.go:117] "RemoveContainer" containerID="e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"
Jul 08 04:48:47.746646 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:48:47.746630    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839\": container with ID starting with e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839 not found: ID does not exist" containerID="e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"
Jul 08 04:48:47.746719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.746657    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839"} err="failed to get container status \"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839\": rpc error: code = NotFound desc = could not find container \"e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839\": container with ID starting with e3cddb2dc5fab7c16727ca698c3996903b300833139fcebed92869ce576e5839 not found: ID does not exist"
Jul 08 04:48:47.746719 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.746679    2562 scope.go:117] "RemoveContainer" containerID="aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"
Jul 08 04:48:47.746931 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:48:47.746912    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0\": container with ID starting with aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0 not found: ID does not exist" containerID="aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"
Jul 08 04:48:47.746997 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.746934    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0"} err="failed to get container status \"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0\": rpc error: code = NotFound desc = could not find container \"aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0\": container with ID starting with aaf20453f6e1468b5b230643e4f986f636b873ed7cb27d89839b32b2cac81bc0 not found: ID does not exist"
Jul 08 04:48:47.756646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.756605    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:47.758587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758565    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758585    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvbzf\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-kube-api-access-pvbzf\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758596    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758605    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758612    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758620    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/066c4ec3-e253-4cda-895d-1e01e83e56c1-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758629    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/066c4ec3-e253-4cda-895d-1e01e83e56c1-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758637    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/066c4ec3-e253-4cda-895d-1e01e83e56c1-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:48:47.758732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:47.758723    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-391befc5-openshift-default-8d8b4bf6c-9zfvf"]
Jul 08 04:48:49.728211 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:49.728181    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" path="/var/lib/kubelet/pods/066c4ec3-e253-4cda-895d-1e01e83e56c1/volumes"
Jul 08 04:48:53.436316 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:53.436282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:48:53.507511 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:48:53.507472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:00.241567 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.241533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:00.627799 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.627719    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:49:00.628125 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628112    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:00.628169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628127    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:00.628169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03db8f5b-a676-490b-83a1-70d56f0fa478" containerName="maas-api"
Jul 08 04:49:00.628169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628147    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03db8f5b-a676-490b-83a1-70d56f0fa478" containerName="maas-api"
Jul 08 04:49:00.628260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628218    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:00.628260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628226    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03db8f5b-a676-490b-83a1-70d56f0fa478" containerName="maas-api"
Jul 08 04:49:00.628260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.628232    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:00.631143 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.631124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.634822 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.634788    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fd2bd8d4-openshift-default-dockercfg-lnkpg\""
Jul 08 04:49:00.650261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.650238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:49:00.671094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671613 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.671613 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.671369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8cjr\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.675653 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.675624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:00.772220 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772414 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772414 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8cjr\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772599 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772599 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772704 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772960 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.772960 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.772947    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.773063 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.773012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.773363 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.773346    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.774532 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.774503    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.774852 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.774834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.786529 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.786507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8cjr\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.786868 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.786838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token\") pod \"e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") " pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:00.941315 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:00.941233    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:01.084516 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.081815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:49:01.086071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.086036    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:01.086186 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.086099    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:01.086186 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.086127    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:01.363882 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.363823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:01.804753 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.804718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerStarted","Data":"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"}
Jul 08 04:49:01.804966 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.804777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerStarted","Data":"1e06a4cde33a7142d13e54d18138ac07ddb6825098dc1c43c6e931047f4d4f56"}
Jul 08 04:49:01.835686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.835603    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podStartSLOduration=1.83558217 podStartE2EDuration="1.83558217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:49:01.832957959 +0000 UTC m=+1832.753586450" watchObservedRunningTime="2026-07-08 04:49:01.83558217 +0000 UTC m=+1832.756210642"
Jul 08 04:49:01.941970 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:01.941938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:02.946348 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:02.946323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:03.814369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:03.814336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:03.815204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:03.815186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:03.936576 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:03.936546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:04.055794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.055755    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:04.056291 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.056272    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:04.056365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.056294    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="066c4ec3-e253-4cda-895d-1e01e83e56c1" containerName="istio-proxy"
Jul 08 04:49:04.059378 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.059357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.063824 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.063806    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fd2bd8d4-serving-cert\""
Jul 08 04:49:04.080315 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.080289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:04.080808 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.080789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:04.100213 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.100186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jzbh\" (UniqueName: \"kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.100360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.100224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.100360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.100316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.201144 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.201104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.201330 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.201168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jzbh\" (UniqueName: \"kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.201330 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.201191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.201330 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:49:04.201300    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-serving-cert: secret "maas-api-e2e-mt-fd2bd8d4-serving-cert" not found
Jul 08 04:49:04.201485 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:49:04.201355    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls podName:fea41e25-1007-4667-8468-98f8b033a22a nodeName:}" failed. No retries permitted until 2026-07-08 04:49:04.701338048 +0000 UTC m=+1835.621966518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls") pod "maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" (UID: "fea41e25-1007-4667-8468-98f8b033a22a") : secret "maas-api-e2e-mt-fd2bd8d4-serving-cert" not found
Jul 08 04:49:04.201729 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.201705    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.216389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.216360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jzbh\" (UniqueName: \"kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.254989 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.254960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:04.507889 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.507786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:04.704701 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.704659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.707134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.707114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") pod \"maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:04.892403 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.892311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:04.969431 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:04.969397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:05.027682 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:05.027649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:05.118477 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:05.118446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:05.119280 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:49:05.119250    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea41e25_1007_4667_8468_98f8b033a22a.slice/crio-48a83af8215fb9005f6d2c9559e50969334c3e3aa11ed49d45622193c05d8425 WatchSource:0}: Error finding container 48a83af8215fb9005f6d2c9559e50969334c3e3aa11ed49d45622193c05d8425: Status 404 returned error can't find the container with id 48a83af8215fb9005f6d2c9559e50969334c3e3aa11ed49d45622193c05d8425
Jul 08 04:49:05.833033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:05.832984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" event={"ID":"fea41e25-1007-4667-8468-98f8b033a22a","Type":"ContainerStarted","Data":"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"}
Jul 08 04:49:05.833208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:05.833072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" event={"ID":"fea41e25-1007-4667-8468-98f8b033a22a","Type":"ContainerStarted","Data":"48a83af8215fb9005f6d2c9559e50969334c3e3aa11ed49d45622193c05d8425"}
Jul 08 04:49:05.833208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:05.833100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:08.462102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:08.462069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:11.189099 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:11.189051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:11.850616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:11.850581    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:11.871751 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:11.871689    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" podStartSLOduration=8.554471789 podStartE2EDuration="8.871673905s" totalImagesPullingTime="317.202116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:49:05.863994938 +0000 UTC m=+1836.784623409" watchObservedRunningTime="2026-07-08 04:49:11.871673905 +0000 UTC m=+1842.792302376"
Jul 08 04:49:17.900838 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.900757    2562 generic.go:356] "Generic (PLEG): container finished" podID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerID="94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6" exitCode=0
Jul 08 04:49:17.901230 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.900840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerDied","Data":"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"}
Jul 08 04:49:17.901271 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.901253    2562 scope.go:117] "RemoveContainer" containerID="94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"
Jul 08 04:49:17.902325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.902298    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:17.902380 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.902368    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:17.902418 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:17.902402    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:49:18.814909 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:18.814874    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:18.909092 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:18.909057    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerStarted","Data":"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"}
Jul 08 04:49:18.942665 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:18.942618    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:18.942884 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:18.942810    2562 patch_prober.go:28] interesting pod/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 04:49:18.942956 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:18.942873    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 04:49:19.941961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:19.941927    2562 patch_prober.go:28] interesting pod/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 04:49:19.942558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:19.942501    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 04:49:20.942564 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:20.942526    2562 patch_prober.go:28] interesting pod/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 04:49:20.943269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:20.943236    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 04:49:21.942694 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:21.942655    2562 patch_prober.go:28] interesting pod/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 08 04:49:21.943317 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:21.943286    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 08 04:49:22.945568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:22.945540    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:22.946039 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:22.945906    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:22.946648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:22.946627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:49:30.553852 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:30.553816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:31.083312 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.083277    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:31.083508 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.083484    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" podUID="fea41e25-1007-4667-8468-98f8b033a22a" containerName="maas-api" containerID="cri-o://6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d" gracePeriod=30
Jul 08 04:49:31.174645 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.174613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:31.328518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.328488    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:31.451324 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.451251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") pod \"fea41e25-1007-4667-8468-98f8b033a22a\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") "
Jul 08 04:49:31.451324 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.451295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jzbh\" (UniqueName: \"kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh\") pod \"fea41e25-1007-4667-8468-98f8b033a22a\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") "
Jul 08 04:49:31.451530 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.451339    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca\") pod \"fea41e25-1007-4667-8468-98f8b033a22a\" (UID: \"fea41e25-1007-4667-8468-98f8b033a22a\") "
Jul 08 04:49:31.451756 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.451733    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fea41e25-1007-4667-8468-98f8b033a22a" (UID: "fea41e25-1007-4667-8468-98f8b033a22a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:49:31.453326 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.453306    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fea41e25-1007-4667-8468-98f8b033a22a" (UID: "fea41e25-1007-4667-8468-98f8b033a22a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:49:31.453667 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.453647    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh" (OuterVolumeSpecName: "kube-api-access-8jzbh") pod "fea41e25-1007-4667-8468-98f8b033a22a" (UID: "fea41e25-1007-4667-8468-98f8b033a22a"). InnerVolumeSpecName "kube-api-access-8jzbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:49:31.551951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.551917    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fea41e25-1007-4667-8468-98f8b033a22a-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:49:31.551951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.551945    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jzbh\" (UniqueName: \"kubernetes.io/projected/fea41e25-1007-4667-8468-98f8b033a22a-kube-api-access-8jzbh\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:49:31.551951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.551955    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fea41e25-1007-4667-8468-98f8b033a22a-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:49:31.980660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.980631    2562 generic.go:356] "Generic (PLEG): container finished" podID="fea41e25-1007-4667-8468-98f8b033a22a" containerID="6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d" exitCode=0
Jul 08 04:49:31.981103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.980672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"
Jul 08 04:49:31.981103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.980712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" event={"ID":"fea41e25-1007-4667-8468-98f8b033a22a","Type":"ContainerDied","Data":"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"}
Jul 08 04:49:31.981103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.980762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q" event={"ID":"fea41e25-1007-4667-8468-98f8b033a22a","Type":"ContainerDied","Data":"48a83af8215fb9005f6d2c9559e50969334c3e3aa11ed49d45622193c05d8425"}
Jul 08 04:49:31.981103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.980784    2562 scope.go:117] "RemoveContainer" containerID="6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"
Jul 08 04:49:31.989370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.989355    2562 scope.go:117] "RemoveContainer" containerID="6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"
Jul 08 04:49:31.989655 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:49:31.989628    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d\": container with ID starting with 6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d not found: ID does not exist" containerID="6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"
Jul 08 04:49:31.989734 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:31.989660    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d"} err="failed to get container status \"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d\": rpc error: code = NotFound desc = could not find container \"6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d\": container with ID starting with 6ded1702aabb934910e0dbca7f59db12cd6f7932c40a13ff0e11af466ecec60d not found: ID does not exist"
Jul 08 04:49:32.008897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:32.008871    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:32.019457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:32.019438    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fd2bd8d4-857df9c58-b5h6q"]
Jul 08 04:49:33.728774 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:33.728740    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fea41e25-1007-4667-8468-98f8b033a22a" path="/var/lib/kubelet/pods/fea41e25-1007-4667-8468-98f8b033a22a/volumes"
Jul 08 04:49:36.648806 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:36.648772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:49:41.729485 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:49:41.729453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:17.928073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:17.928042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:19.299000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:19.298962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:25.219248 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:25.219216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:25.362663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:25.362631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:25.533052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:25.533024    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:50:25.533253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:25.533232    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy" containerID="cri-o://575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625" gracePeriod=30
Jul 08 04:50:25.561070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:25.561032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:26.870531 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:26.870495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:26.967402 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:26.967369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:27.065984 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:27.065956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:27.821771 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:27.821745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:27.916207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:27.916173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:28.015565 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:28.015537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:50:30.779880 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.779837    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:50:30.881559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8cjr\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881559 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881637    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881795 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881810    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:50:30.881994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881824    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.881994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.881948    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo\") pod \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\" (UID: \"5a83194b-0dec-4570-85b8-ab78ae2a06c0\") "
Jul 08 04:50:30.882204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882030    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:50:30.882204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882148    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:50:30.882204 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882164    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:50:30.882361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882335    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.882361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882358    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.882470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882372    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.882470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882383    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.882470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.882425    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:50:30.883871 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.883822    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr" (OuterVolumeSpecName: "kube-api-access-j8cjr") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "kube-api-access-j8cjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:50:30.883978 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.883932    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:50:30.884023 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.883988    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:50:30.884023 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.883994    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a83194b-0dec-4570-85b8-ab78ae2a06c0" (UID: "5a83194b-0dec-4570-85b8-ab78ae2a06c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:50:30.983386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.983351    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.983386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.983380    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.983386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.983388    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.983386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.983396    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a83194b-0dec-4570-85b8-ab78ae2a06c0-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:30.983646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:30.983405    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8cjr\" (UniqueName: \"kubernetes.io/projected/5a83194b-0dec-4570-85b8-ab78ae2a06c0-kube-api-access-j8cjr\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:50:31.289710 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.289680    2562 generic.go:356] "Generic (PLEG): container finished" podID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerID="575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625" exitCode=0
Jul 08 04:50:31.289915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.289726    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"
Jul 08 04:50:31.289915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.289764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerDied","Data":"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"}
Jul 08 04:50:31.289915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.289821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw" event={"ID":"5a83194b-0dec-4570-85b8-ab78ae2a06c0","Type":"ContainerDied","Data":"1e06a4cde33a7142d13e54d18138ac07ddb6825098dc1c43c6e931047f4d4f56"}
Jul 08 04:50:31.289915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.289849    2562 scope.go:117] "RemoveContainer" containerID="575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"
Jul 08 04:50:31.299592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.299571    2562 scope.go:117] "RemoveContainer" containerID="94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"
Jul 08 04:50:31.313360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.313335    2562 scope.go:117] "RemoveContainer" containerID="575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"
Jul 08 04:50:31.313978 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:50:31.313749    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625\": container with ID starting with 575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625 not found: ID does not exist" containerID="575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"
Jul 08 04:50:31.313978 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.313809    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625"} err="failed to get container status \"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625\": rpc error: code = NotFound desc = could not find container \"575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625\": container with ID starting with 575fac85ea9d812f26586afbde16282a09b714332c60fb7b64f16e9756f99625 not found: ID does not exist"
Jul 08 04:50:31.313978 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.313834    2562 scope.go:117] "RemoveContainer" containerID="94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"
Jul 08 04:50:31.314368 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:50:31.314338    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6\": container with ID starting with 94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6 not found: ID does not exist" containerID="94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"
Jul 08 04:50:31.314473 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.314374    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6"} err="failed to get container status \"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6\": rpc error: code = NotFound desc = could not find container \"94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6\": container with ID starting with 94e885ba264cf45c6935b07211a5b90466f0b91c06ae9b0468c04d88765977f6 not found: ID does not exist"
Jul 08 04:50:31.315631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.315612    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:50:31.319318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.319298    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fd2bd8d4-openshift-default-54856d6747-z8stw"]
Jul 08 04:50:31.728141 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:31.728112    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" path="/var/lib/kubelet/pods/5a83194b-0dec-4570-85b8-ab78ae2a06c0/volumes"
Jul 08 04:50:59.269154 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:50:59.269116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:05.248669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:05.248623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:10.788789 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:10.788747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:10.888874 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:10.888820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:29.784631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:29.784548    2562 scope.go:117] "RemoveContainer" containerID="b386e49c9153015e566d665a97d252fde5d673b7a869fe4b96bfc868b25d4fd9"
Jul 08 04:51:34.915990 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:34.915960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:35.011395 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:35.011366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:41.388119 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:41.388089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:51:47.002030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:51:47.001998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:01.399536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:01.399495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:01.466457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:01.466430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:01.640077 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:01.640045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:01.739961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:01.739928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:12.159388 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:12.159359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:12.502524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:12.502493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:18.944108 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:18.944079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:19.044577 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:19.044536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:33.494474 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:33.494436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:39.121393 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.121361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:39.223049 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.223019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:39.456110 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.456024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:39.759187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759156    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:52:39.759504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759492    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759505    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759514    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fea41e25-1007-4667-8468-98f8b033a22a" containerName="maas-api"
Jul 08 04:52:39.759556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759519    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fea41e25-1007-4667-8468-98f8b033a22a" containerName="maas-api"
Jul 08 04:52:39.759556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759527    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759532    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759713 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759594    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759713 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759604    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a83194b-0dec-4570-85b8-ab78ae2a06c0" containerName="istio-proxy"
Jul 08 04:52:39.759713 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.759610    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fea41e25-1007-4667-8468-98f8b033a22a" containerName="maas-api"
Jul 08 04:52:39.762425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.762410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.767742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.767718    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f87c81-openshift-default-dockercfg-jpmwj\""
Jul 08 04:52:39.773805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.773785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:39.796071 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.796045    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:52:39.878959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.878920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.878974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879134 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6tbp\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.879280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.879259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6tbp\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980505 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980505 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980711 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980503    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.980798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.980684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.981186 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.981164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.982378 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.982357    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.982614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.982597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.989660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.989636    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:39.989821 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:39.989805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6tbp\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp\") pod \"e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") " pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:40.072528 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.072442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:40.204836 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.204795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:40.230674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.230648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:52:40.232676 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:52:40.232646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode750fd06_bca4_4e9e_bef0_1630c9a1d749.slice/crio-5b1649a1e2689fea876606f11a79b6dce57ac0b507e1248040e1de8bcbda6bc1 WatchSource:0}: Error finding container 5b1649a1e2689fea876606f11a79b6dce57ac0b507e1248040e1de8bcbda6bc1: Status 404 returned error can't find the container with id 5b1649a1e2689fea876606f11a79b6dce57ac0b507e1248040e1de8bcbda6bc1
Jul 08 04:52:40.235099 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.235064    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:52:40.235196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.235133    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:52:40.235196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.235164    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:52:40.944276 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.944242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerStarted","Data":"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"}
Jul 08 04:52:40.944447 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.944336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerStarted","Data":"5b1649a1e2689fea876606f11a79b6dce57ac0b507e1248040e1de8bcbda6bc1"}
Jul 08 04:52:40.970594 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:40.970549    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podStartSLOduration=1.9705356109999999 podStartE2EDuration="1.970535611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:52:40.9699347 +0000 UTC m=+2051.890563192" watchObservedRunningTime="2026-07-08 04:52:40.970535611 +0000 UTC m=+2051.891164082"
Jul 08 04:52:41.073270 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:41.073234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:41.078197 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:41.078175    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:41.950103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:41.950075    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:41.950947 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:41.950928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:52:42.904942 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.904907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:42.978771 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.978736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:52:42.982198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.982177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:42.984238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.984216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:42.984556 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.984543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f87c81-serving-cert\""
Jul 08 04:52:42.994260 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:42.994238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:52:43.053178 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.053153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:43.107739 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.107709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.107926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.107756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vpk\" (UniqueName: \"kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.107926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.107843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.209286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.209196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.209286 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.209250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vpk\" (UniqueName: \"kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.209522 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.209291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.209522 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:52:43.209449    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-serving-cert: secret "maas-api-e2e-inf-a-f87c81-serving-cert" not found
Jul 08 04:52:43.209636 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:52:43.209527    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls podName:8c8ce53c-10e7-4305-9ea1-33fb5035a481 nodeName:}" failed. No retries permitted until 2026-07-08 04:52:43.709506908 +0000 UTC m=+2054.630135375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls") pod "maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" (UID: "8c8ce53c-10e7-4305-9ea1-33fb5035a481") : secret "maas-api-e2e-inf-a-f87c81-serving-cert" not found
Jul 08 04:52:43.209951 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.209929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.218128 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.218106    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vpk\" (UniqueName: \"kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.388834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.388797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:43.489358 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.489328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:43.589454 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.589425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:43.714730 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.714696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.716926 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.716898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") pod \"maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:43.896191 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:43.896106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:44.030644 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.030616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:52:44.032443 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:52:44.032414    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8ce53c_10e7_4305_9ea1_33fb5035a481.slice/crio-2a76a00a10d79d80797d2f4b1031433e340744e7a6889257f8fe96a0f2a06a6b WatchSource:0}: Error finding container 2a76a00a10d79d80797d2f4b1031433e340744e7a6889257f8fe96a0f2a06a6b: Status 404 returned error can't find the container with id 2a76a00a10d79d80797d2f4b1031433e340744e7a6889257f8fe96a0f2a06a6b
Jul 08 04:52:44.034004 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.033981    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:52:44.969891 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.969826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" event={"ID":"8c8ce53c-10e7-4305-9ea1-33fb5035a481","Type":"ContainerStarted","Data":"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"}
Jul 08 04:52:44.970066 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.969906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" event={"ID":"8c8ce53c-10e7-4305-9ea1-33fb5035a481","Type":"ContainerStarted","Data":"2a76a00a10d79d80797d2f4b1031433e340744e7a6889257f8fe96a0f2a06a6b"}
Jul 08 04:52:44.970066 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.970021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:44.986410 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:44.986318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" podStartSLOduration=2.283385028 podStartE2EDuration="2.986305511s" totalImagesPullingTime="702.920483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:52:44.986181037 +0000 UTC m=+2055.906809511" watchObservedRunningTime="2026-07-08 04:52:44.986305511 +0000 UTC m=+2055.906933982"
Jul 08 04:52:47.393652 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:47.393618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:47.773421 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:47.773393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:48.037289 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:48.037160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:48.227238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:48.227200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:50.741832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.741801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:50.832412 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.832374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:50.947309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.947278    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:52:50.951024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.950999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:50.953773 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.953751    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-76a8b4-serving-cert\""
Jul 08 04:52:50.967692 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.967668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:52:50.979712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:50.979691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:52:51.002085 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.001985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:51.086276 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.086245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.086276 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.086275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.086519 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.086338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kx6t\" (UniqueName: \"kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.187732 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.187700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.187944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.187739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.187944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.187770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx6t\" (UniqueName: \"kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.187944 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:52:51.187912    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-serving-cert: secret "maas-api-e2e-inf-b-76a8b4-serving-cert" not found
Jul 08 04:52:51.188072 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:52:51.187993    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls podName:747b6518-4bb0-47a4-b3c0-12a8191eca89 nodeName:}" failed. No retries permitted until 2026-07-08 04:52:51.687972028 +0000 UTC m=+2062.608600496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls") pod "maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" (UID: "747b6518-4bb0-47a4-b3c0-12a8191eca89") : secret "maas-api-e2e-inf-b-76a8b4-serving-cert" not found
Jul 08 04:52:51.188600 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.188576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.198582 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.198554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx6t\" (UniqueName: \"kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.354910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.354776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:51.519542 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.519499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:51.617123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.617035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:51.691381 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.691349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.693981 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.693953    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") pod \"maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:51.863570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:51.863534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:52.002794 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:52.002759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:52:52.004904 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:52:52.004874    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747b6518_4bb0_47a4_b3c0_12a8191eca89.slice/crio-807ff038473daee41c84696ae74232eb523d0ddc0e773191e75ebad4caa20a74 WatchSource:0}: Error finding container 807ff038473daee41c84696ae74232eb523d0ddc0e773191e75ebad4caa20a74: Status 404 returned error can't find the container with id 807ff038473daee41c84696ae74232eb523d0ddc0e773191e75ebad4caa20a74
Jul 08 04:52:53.015101 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:53.015067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" event={"ID":"747b6518-4bb0-47a4-b3c0-12a8191eca89","Type":"ContainerStarted","Data":"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"}
Jul 08 04:52:53.015496 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:53.015148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" event={"ID":"747b6518-4bb0-47a4-b3c0-12a8191eca89","Type":"ContainerStarted","Data":"807ff038473daee41c84696ae74232eb523d0ddc0e773191e75ebad4caa20a74"}
Jul 08 04:52:53.015496 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:53.015193    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:53.034397 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:53.034337    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" podStartSLOduration=2.649103523 podStartE2EDuration="3.034317812s" totalImagesPullingTime="385.214289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:52:53.031750113 +0000 UTC m=+2063.952378613" watchObservedRunningTime="2026-07-08 04:52:53.034317812 +0000 UTC m=+2063.954946286"
Jul 08 04:52:55.207234 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:55.207202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:52:57.993034 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:57.992998    2562 patch_prober.go:28] interesting pod/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 04:52:57.993404 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:57.993059    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 04:52:59.026128 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.026097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:52:59.047122 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.047049    2562 generic.go:356] "Generic (PLEG): container finished" podID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerID="95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158" exitCode=0
Jul 08 04:52:59.047122 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.047102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerDied","Data":"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"}
Jul 08 04:52:59.047451 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.047438    2562 scope.go:117] "RemoveContainer" containerID="95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"
Jul 08 04:52:59.048475 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.048443    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:52:59.048533 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.048510    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:52:59.048568 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:52:59.048546    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:53:00.057552 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:00.057518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerStarted","Data":"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"}
Jul 08 04:53:00.072634 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:00.072608    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:53:00.072893 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:00.072844    2562 patch_prober.go:28] interesting pod/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 04:53:00.072971 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:00.072936    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 04:53:00.227396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:00.227364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:01.073584 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:01.073548    2562 patch_prober.go:28] interesting pod/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 04:53:01.073991 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:01.073611    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 04:53:02.073052 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:02.073014    2562 patch_prober.go:28] interesting pod/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 04:53:02.073261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:02.073070    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 04:53:03.073340 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:03.073304    2562 patch_prober.go:28] interesting pod/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 08 04:53:03.073721 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:03.073358    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 08 04:53:04.077308 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:04.077278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:53:04.077814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:04.077644    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:53:04.078579 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:04.078561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:53:04.214558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:04.214531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:04.319289 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:04.319255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:10.245315 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:10.245281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:12.398311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:12.398274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:12.495611 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:12.495581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:29.700452 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:29.700424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:53:29.706586 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:29.706565    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:53:30.744202 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:30.744169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:47.963466 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:47.963426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:48.265289 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:48.265258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:48.465792 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:48.465758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.061840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.061805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.128242 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.128211    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:53:51.131539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.131517    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.141362 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.141343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.142840 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.142824    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-a4325b-serving-cert\""
Jul 08 04:53:51.156506 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.156475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:53:51.217111 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.217067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chf8\" (UniqueName: \"kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.217111 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.217108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.217343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.217176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.318343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.318245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.318343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.318325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chf8\" (UniqueName: \"kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.318593 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.318346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.318593 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:53:51.318430    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-serving-cert: secret "maas-api-e2e-reuse-a4325b-serving-cert" not found
Jul 08 04:53:51.318593 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:53:51.318522    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls podName:2b56a3d6-64e6-41af-bc7e-d74326062b77 nodeName:}" failed. No retries permitted until 2026-07-08 04:53:51.818501712 +0000 UTC m=+2122.739130163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls") pod "maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" (UID: "2b56a3d6-64e6-41af-bc7e-d74326062b77") : secret "maas-api-e2e-reuse-a4325b-serving-cert" not found
Jul 08 04:53:51.319070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.319052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.320616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.320596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.365094 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.365052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chf8\" (UniqueName: \"kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.663382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.663282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.822723 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.822680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.825085 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.825061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") pod \"maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:51.858026 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.857997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:51.956535 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:51.956443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:52.042823 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:52.042783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:52.185917 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:52.185885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:53:52.187982 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:53:52.187954    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b56a3d6_64e6_41af_bc7e_d74326062b77.slice/crio-310bd1e10e7ba7b7cfe00032447675ec5882d9a3088a125b062ede39b3927354 WatchSource:0}: Error finding container 310bd1e10e7ba7b7cfe00032447675ec5882d9a3088a125b062ede39b3927354: Status 404 returned error can't find the container with id 310bd1e10e7ba7b7cfe00032447675ec5882d9a3088a125b062ede39b3927354
Jul 08 04:53:52.338298 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:52.338259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" event={"ID":"2b56a3d6-64e6-41af-bc7e-d74326062b77","Type":"ContainerStarted","Data":"310bd1e10e7ba7b7cfe00032447675ec5882d9a3088a125b062ede39b3927354"}
Jul 08 04:53:53.345311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:53.345270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" event={"ID":"2b56a3d6-64e6-41af-bc7e-d74326062b77","Type":"ContainerStarted","Data":"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"}
Jul 08 04:53:53.345701 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:53.345421    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:53:53.369088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:53.369028    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" podStartSLOduration=1.921017305 podStartE2EDuration="2.369011379s" totalImagesPullingTime="447.994074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:53:53.36757687 +0000 UTC m=+2124.288205345" watchObservedRunningTime="2026-07-08 04:53:53.369011379 +0000 UTC m=+2124.289639851"
Jul 08 04:53:55.560170 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:55.560132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:53:59.356198 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:53:59.356166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:54:16.587674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.587636    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:16.591188 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.591169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.594105 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.594069    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-a4325b\"/\"default-dockercfg-nz5kl\""
Jul 08 04:54:16.594238 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.594113    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-a4325b\"/\"kube-root-ca.crt\""
Jul 08 04:54:16.595095 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.595075    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-a4325b\"/\"openshift-service-ca.crt\""
Jul 08 04:54:16.595199 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.595129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-a4325b\"/\"test-model-a4325b-kserve-self-signed-certs\""
Jul 08 04:54:16.602907 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.602848    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:16.627567 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.627528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:16.643695 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.643839 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.643839 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.643839 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.644011 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpm49\" (UniqueName: \"kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.644011 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.643904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.744648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.744831 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.744831 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.744831 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.745019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpm49\" (UniqueName: \"kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.745019 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.744919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.745120 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.745047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.745178 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.745142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.745178 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.745169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.746977 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.746949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.747208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.747192    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.753583 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.753561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpm49\" (UniqueName: \"kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49\") pod \"test-model-a4325b-kserve-cdcdb495f-sbf9s\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") " pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:16.902051 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:16.901951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:17.031639 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:17.031602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:17.033729 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:54:17.033699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9833a407_6bc8_4e80_b92e_1ffefdfb1b5a.slice/crio-de49ba06de66b68e6d3af96109323d765649ad875dc02572f7731df8296c743a WatchSource:0}: Error finding container de49ba06de66b68e6d3af96109323d765649ad875dc02572f7731df8296c743a: Status 404 returned error can't find the container with id de49ba06de66b68e6d3af96109323d765649ad875dc02572f7731df8296c743a
Jul 08 04:54:17.469104 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:17.469065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" event={"ID":"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a","Type":"ContainerStarted","Data":"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"}
Jul 08 04:54:17.469104 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:17.469104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" event={"ID":"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a","Type":"ContainerStarted","Data":"de49ba06de66b68e6d3af96109323d765649ad875dc02572f7731df8296c743a"}
Jul 08 04:54:17.487694 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:17.487649    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" podStartSLOduration=1.487635262 podStartE2EDuration="1.487635262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:54:17.487310043 +0000 UTC m=+2148.407938526" watchObservedRunningTime="2026-07-08 04:54:17.487635262 +0000 UTC m=+2148.408263735"
Jul 08 04:54:26.902783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:26.902699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:26.902783 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:26.902757    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:26.915030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:26.915006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:27.533101 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:27.533069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:32.719294 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:32.719262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:33.103297 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.103260    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:54:33.103514 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.103469    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" podUID="2b56a3d6-64e6-41af-bc7e-d74326062b77" containerName="maas-api" containerID="cri-o://0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721" gracePeriod=30
Jul 08 04:54:33.103810 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.103787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:33.168273 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.168243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:33.351196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.351174    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:54:33.499685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.499657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9chf8\" (UniqueName: \"kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8\") pod \"2b56a3d6-64e6-41af-bc7e-d74326062b77\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") "
Jul 08 04:54:33.499908 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.499709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") pod \"2b56a3d6-64e6-41af-bc7e-d74326062b77\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") "
Jul 08 04:54:33.499908 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.499768    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca\") pod \"2b56a3d6-64e6-41af-bc7e-d74326062b77\" (UID: \"2b56a3d6-64e6-41af-bc7e-d74326062b77\") "
Jul 08 04:54:33.500156 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.500134    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b56a3d6-64e6-41af-bc7e-d74326062b77" (UID: "2b56a3d6-64e6-41af-bc7e-d74326062b77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:54:33.501737 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.501716    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b56a3d6-64e6-41af-bc7e-d74326062b77" (UID: "2b56a3d6-64e6-41af-bc7e-d74326062b77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:54:33.501804 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.501730    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8" (OuterVolumeSpecName: "kube-api-access-9chf8") pod "2b56a3d6-64e6-41af-bc7e-d74326062b77" (UID: "2b56a3d6-64e6-41af-bc7e-d74326062b77"). InnerVolumeSpecName "kube-api-access-9chf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:54:33.554133 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.554102    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b56a3d6-64e6-41af-bc7e-d74326062b77" containerID="0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721" exitCode=0
Jul 08 04:54:33.554290 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.554154    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"
Jul 08 04:54:33.554290 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.554188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" event={"ID":"2b56a3d6-64e6-41af-bc7e-d74326062b77","Type":"ContainerDied","Data":"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"}
Jul 08 04:54:33.554290 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.554241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb" event={"ID":"2b56a3d6-64e6-41af-bc7e-d74326062b77","Type":"ContainerDied","Data":"310bd1e10e7ba7b7cfe00032447675ec5882d9a3088a125b062ede39b3927354"}
Jul 08 04:54:33.554290 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.554264    2562 scope.go:117] "RemoveContainer" containerID="0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"
Jul 08 04:54:33.563812 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.563791    2562 scope.go:117] "RemoveContainer" containerID="0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"
Jul 08 04:54:33.564067 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:54:33.564049    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721\": container with ID starting with 0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721 not found: ID does not exist" containerID="0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"
Jul 08 04:54:33.564124 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.564077    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721"} err="failed to get container status \"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721\": rpc error: code = NotFound desc = could not find container \"0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721\": container with ID starting with 0aee9e9aa81f0cb70495736761c3e73a11bf6e480aa0718896c90e69da19e721 not found: ID does not exist"
Jul 08 04:54:33.576155 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.576129    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:54:33.580536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.580510    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-a4325b-8cf555b6d-5zgsb"]
Jul 08 04:54:33.600526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.600498    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b56a3d6-64e6-41af-bc7e-d74326062b77-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:33.600526 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.600522    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9chf8\" (UniqueName: \"kubernetes.io/projected/2b56a3d6-64e6-41af-bc7e-d74326062b77-kube-api-access-9chf8\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:33.600652 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.600538    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b56a3d6-64e6-41af-bc7e-d74326062b77-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:33.729646 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:33.729607    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b56a3d6-64e6-41af-bc7e-d74326062b77" path="/var/lib/kubelet/pods/2b56a3d6-64e6-41af-bc7e-d74326062b77/volumes"
Jul 08 04:54:38.077012 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:38.076968    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:38.172080 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:38.172043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:50.582984 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:50.582952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:53.035072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.035036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:53.096752 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.096704    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" podUID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" containerName="main" containerID="cri-o://fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9" gracePeriod=45
Jul 08 04:54:53.097938 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.097917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:54:53.350960 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.350929    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:53.377947 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.377917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.377986    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpm49\" (UniqueName: \"kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378111    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378332 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378171    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir\") pod \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\" (UID: \"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a\") "
Jul 08 04:54:53.378503 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378454    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:54:53.378663 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378591    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:54:53.378882 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.378838    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home" (OuterVolumeSpecName: "home") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:54:53.380707 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.380680    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm" (OuterVolumeSpecName: "dshm") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:54:53.380792 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.380780    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:54:53.380835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.380789    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49" (OuterVolumeSpecName: "kube-api-access-cpm49") pod "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" (UID: "9833a407-6bc8-4e80-b92e-1ffefdfb1b5a"). InnerVolumeSpecName "kube-api-access-cpm49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:54:53.479306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479277    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tmp-dir\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.479306 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479303    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-tls-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.479558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479314    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-dshm\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.479558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479325    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-home\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.479558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479334    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpm49\" (UniqueName: \"kubernetes.io/projected/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-kube-api-access-cpm49\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.479558 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.479346    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a-model-cache\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:54:53.664267 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.664183    2562 generic.go:356] "Generic (PLEG): container finished" podID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" containerID="fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9" exitCode=0
Jul 08 04:54:53.664267 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.664229    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"
Jul 08 04:54:53.664457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.664268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" event={"ID":"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a","Type":"ContainerDied","Data":"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"}
Jul 08 04:54:53.664457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.664312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s" event={"ID":"9833a407-6bc8-4e80-b92e-1ffefdfb1b5a","Type":"ContainerDied","Data":"de49ba06de66b68e6d3af96109323d765649ad875dc02572f7731df8296c743a"}
Jul 08 04:54:53.664457 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.664334    2562 scope.go:117] "RemoveContainer" containerID="fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"
Jul 08 04:54:53.673309 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.673290    2562 scope.go:117] "RemoveContainer" containerID="fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"
Jul 08 04:54:53.673564 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:54:53.673545    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9\": container with ID starting with fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9 not found: ID does not exist" containerID="fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"
Jul 08 04:54:53.673626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.673572    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9"} err="failed to get container status \"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9\": rpc error: code = NotFound desc = could not find container \"fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9\": container with ID starting with fa4b717ab2b718fdb70187e043d11b29ee1fb6a53661858b44d076f7373299b9 not found: ID does not exist"
Jul 08 04:54:53.699222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.698480    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:53.705354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.705313    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-a4325b/test-model-a4325b-kserve-cdcdb495f-sbf9s"]
Jul 08 04:54:53.729563 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:54:53.729529    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" path="/var/lib/kubelet/pods/9833a407-6bc8-4e80-b92e-1ffefdfb1b5a/volumes"
Jul 08 04:55:14.383654 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:14.383621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:15.458463 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:15.458418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:21.078801 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:21.078766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:21.179414 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:21.179379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:21.351247 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:21.351173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:22.202445 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.202411    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:55:22.203013 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.202993    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b56a3d6-64e6-41af-bc7e-d74326062b77" containerName="maas-api"
Jul 08 04:55:22.203126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.203015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b56a3d6-64e6-41af-bc7e-d74326062b77" containerName="maas-api"
Jul 08 04:55:22.203126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.203029    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" containerName="main"
Jul 08 04:55:22.203126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.203038    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" containerName="main"
Jul 08 04:55:22.203126 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.203115    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b56a3d6-64e6-41af-bc7e-d74326062b77" containerName="maas-api"
Jul 08 04:55:22.203322 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.203130    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9833a407-6bc8-4e80-b92e-1ffefdfb1b5a" containerName="main"
Jul 08 04:55:22.206132 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.206112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.208835 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.208815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-a4325b-openshift-default-dockercfg-s26sl\""
Jul 08 04:55:22.219488 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.219468    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:55:22.228614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.228593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:22.336553 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2w2\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336742 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.336961 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.337073 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.336973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438430 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2w2\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438430 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438438    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.438660 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.438924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439157 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.439010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.439231    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439396 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.439353    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.439717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.439695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.441038 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.441014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.441305 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.441289    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.452606 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.452547    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.452741 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.452723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2w2\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2\") pod \"e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") " pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.514676 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.514635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:22.515536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.515516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:22.655944 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.655918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:55:22.657156 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:55:22.657132    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e4b85e_e7a7_4127_866c_dba8f9d45baa.slice/crio-c66a24da7dc02dc42fb6b50fbdfab384e33cad7d28eed70ec1e9a08b88603b2f WatchSource:0}: Error finding container c66a24da7dc02dc42fb6b50fbdfab384e33cad7d28eed70ec1e9a08b88603b2f: Status 404 returned error can't find the container with id c66a24da7dc02dc42fb6b50fbdfab384e33cad7d28eed70ec1e9a08b88603b2f
Jul 08 04:55:22.659169 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.659141    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:22.659241 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.659204    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:22.659241 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.659231    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:22.818292 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.818261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerStarted","Data":"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"}
Jul 08 04:55:22.818482 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.818313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerStarted","Data":"c66a24da7dc02dc42fb6b50fbdfab384e33cad7d28eed70ec1e9a08b88603b2f"}
Jul 08 04:55:22.841805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:22.841755    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" podStartSLOduration=0.841737792 podStartE2EDuration="841.737792ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:55:22.840776866 +0000 UTC m=+2213.761405359" watchObservedRunningTime="2026-07-08 04:55:22.841737792 +0000 UTC m=+2213.762366264"
Jul 08 04:55:23.516272 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:23.516229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:23.521372 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:23.521347    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:23.824184 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:23.824098    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:23.825159 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:23.825137    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:24.124894 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:24.124770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:24.210617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:24.210565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:24.283524 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:24.283489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:24.484360 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:24.484330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:28.603854 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:28.603819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:37.903841 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.903756    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerID="6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba" exitCode=0
Jul 08 04:55:37.904253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.903832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerDied","Data":"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"}
Jul 08 04:55:37.904253 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.904238    2562 scope.go:117] "RemoveContainer" containerID="6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"
Jul 08 04:55:37.905255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.905223    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:37.905371 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.905319    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:37.905434 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:37.905368    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:55:38.824212 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:38.824178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:38.912263 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:38.912229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerStarted","Data":"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"}
Jul 08 04:55:38.955100 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:38.955050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:55:39.516153 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:39.516115    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:39.517327 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:39.517300    2562 patch_prober.go:28] interesting pod/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 08 04:55:39.517447 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:39.517348    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 08 04:55:40.516969 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:40.516932    2562 patch_prober.go:28] interesting pod/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 08 04:55:40.517369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:40.516989    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 08 04:55:41.516142 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:41.516109    2562 patch_prober.go:28] interesting pod/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 08 04:55:41.516328 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:41.516167    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 08 04:55:42.549905 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:42.549840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:42.550356 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:42.550327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:42.551617 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:42.551597    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:55:44.169999 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:55:44.169964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:56:16.720375 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:56:16.720340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:56:17.875972 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:56:17.875936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:56:22.185340 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:56:22.185307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:56:59.002947 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:56:59.002881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:56:59.435228 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:56:59.435140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:05.530382 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:05.530344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:05.629910 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:05.629852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:05.892189 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:05.892104    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:57:05.892366 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:05.892342    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy" containerID="cri-o://4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284" gracePeriod=30
Jul 08 04:57:05.929986 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:05.929958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:06.991640 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:06.991608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.018072 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.018044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.167369 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.167332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.557867 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.557826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.655388 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.655357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.758112 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.758066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:08.882735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.882650    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:57:08.882943 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.882919    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" podUID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" containerName="maas-api" containerID="cri-o://5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2" gracePeriod=30
Jul 08 04:57:08.916927 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:08.916895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:09.133291 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.133223    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:57:09.223024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.222990    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") pod \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") "
Jul 08 04:57:09.223187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.223080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca\") pod \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") "
Jul 08 04:57:09.223187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.223133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7vpk\" (UniqueName: \"kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk\") pod \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\" (UID: \"8c8ce53c-10e7-4305-9ea1-33fb5035a481\") "
Jul 08 04:57:09.223470 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.223441    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c8ce53c-10e7-4305-9ea1-33fb5035a481" (UID: "8c8ce53c-10e7-4305-9ea1-33fb5035a481"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:57:09.225116 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.225082    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk" (OuterVolumeSpecName: "kube-api-access-k7vpk") pod "8c8ce53c-10e7-4305-9ea1-33fb5035a481" (UID: "8c8ce53c-10e7-4305-9ea1-33fb5035a481"). InnerVolumeSpecName "kube-api-access-k7vpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:09.225376 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.225354    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c8ce53c-10e7-4305-9ea1-33fb5035a481" (UID: "8c8ce53c-10e7-4305-9ea1-33fb5035a481"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:57:09.324102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.324065    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8ce53c-10e7-4305-9ea1-33fb5035a481-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:09.324102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.324094    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8ce53c-10e7-4305-9ea1-33fb5035a481-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:09.324102 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.324104    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7vpk\" (UniqueName: \"kubernetes.io/projected/8c8ce53c-10e7-4305-9ea1-33fb5035a481-kube-api-access-k7vpk\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:09.388166 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.388066    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" containerID="5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2" exitCode=0
Jul 08 04:57:09.388166 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.388114    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"
Jul 08 04:57:09.388166 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.388151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" event={"ID":"8c8ce53c-10e7-4305-9ea1-33fb5035a481","Type":"ContainerDied","Data":"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"}
Jul 08 04:57:09.388448 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.388221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg" event={"ID":"8c8ce53c-10e7-4305-9ea1-33fb5035a481","Type":"ContainerDied","Data":"2a76a00a10d79d80797d2f4b1031433e340744e7a6889257f8fe96a0f2a06a6b"}
Jul 08 04:57:09.388448 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.388250    2562 scope.go:117] "RemoveContainer" containerID="5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"
Jul 08 04:57:09.397912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.397895    2562 scope.go:117] "RemoveContainer" containerID="5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"
Jul 08 04:57:09.398178 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:09.398160    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2\": container with ID starting with 5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2 not found: ID does not exist" containerID="5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"
Jul 08 04:57:09.398227 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.398186    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2"} err="failed to get container status \"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2\": rpc error: code = NotFound desc = could not find container \"5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2\": container with ID starting with 5193256d1404ef0103e27907a72256293e2169574d78d6b6f91dac00976336e2 not found: ID does not exist"
Jul 08 04:57:09.410298 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.410274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:57:09.416676 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.416656    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f87c81-dd464f85-6qpgg"]
Jul 08 04:57:09.728584 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:09.728552    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" path="/var/lib/kubelet/pods/8c8ce53c-10e7-4305-9ea1-33fb5035a481/volumes"
Jul 08 04:57:11.145965 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.145942    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:57:11.240425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb2w2\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240433    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240486    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240579    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240604    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token\") pod \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\" (UID: \"f9e4b85e-e7a7-4127-866c-dba8f9d45baa\") "
Jul 08 04:57:11.240950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240829    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:11.240950 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.240837    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:11.241136 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.241061    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.241136 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.241080    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.241269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.241234    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:11.241351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.241294    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:57:11.241533 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.241508    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:11.242687 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.242661    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:57:11.242813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.242722    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:11.242813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.242742    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2" (OuterVolumeSpecName: "kube-api-access-wb2w2") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "kube-api-access-wb2w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:11.243135 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.243118    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9e4b85e-e7a7-4127-866c-dba8f9d45baa" (UID: "f9e4b85e-e7a7-4127-866c-dba8f9d45baa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:11.341638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341609    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb2w2\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-kube-api-access-wb2w2\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341633    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341638 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341643    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341651    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341658    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341667    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.341898 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.341674    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e4b85e-e7a7-4127-866c-dba8f9d45baa-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:11.406853 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.406819    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerID="4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284" exitCode=0
Jul 08 04:57:11.407030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.406901    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"
Jul 08 04:57:11.407030 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.406899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerDied","Data":"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"}
Jul 08 04:57:11.407164 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.407043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx" event={"ID":"f9e4b85e-e7a7-4127-866c-dba8f9d45baa","Type":"ContainerDied","Data":"c66a24da7dc02dc42fb6b50fbdfab384e33cad7d28eed70ec1e9a08b88603b2f"}
Jul 08 04:57:11.407164 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.407064    2562 scope.go:117] "RemoveContainer" containerID="4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"
Jul 08 04:57:11.416370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.416353    2562 scope.go:117] "RemoveContainer" containerID="6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"
Jul 08 04:57:11.424255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.424226    2562 scope.go:117] "RemoveContainer" containerID="4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"
Jul 08 04:57:11.424487 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:11.424464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284\": container with ID starting with 4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284 not found: ID does not exist" containerID="4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"
Jul 08 04:57:11.424584 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.424492    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284"} err="failed to get container status \"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284\": rpc error: code = NotFound desc = could not find container \"4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284\": container with ID starting with 4c9294b51e99e5088e01afc6a3415c2cb530a221bc17e17fa6f0d42d04f5a284 not found: ID does not exist"
Jul 08 04:57:11.424584 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.424509    2562 scope.go:117] "RemoveContainer" containerID="6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"
Jul 08 04:57:11.424749 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:11.424731    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba\": container with ID starting with 6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba not found: ID does not exist" containerID="6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"
Jul 08 04:57:11.424789 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.424753    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba"} err="failed to get container status \"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba\": rpc error: code = NotFound desc = could not find container \"6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba\": container with ID starting with 6016fc47485b5ab6035323fa1fe27e98f08a397fa81ed220fa19b4471fa4a0ba not found: ID does not exist"
Jul 08 04:57:11.429103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.429079    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:57:11.432925 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.432905    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-a4325b-openshift-default-6f4b5f7b85-6czsx"]
Jul 08 04:57:11.728278 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:11.728254    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" path="/var/lib/kubelet/pods/f9e4b85e-e7a7-4127-866c-dba8f9d45baa/volumes"
Jul 08 04:57:13.634825 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:13.634796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:19.799140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:19.799108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:19.899439 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:19.899406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:32.984228 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:32.984190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:33.035976 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:33.035945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:50.294275 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:50.294235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:50.542532 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:50.542501    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:57:50.542757 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:50.542736    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy" containerID="cri-o://63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43" gracePeriod=30
Jul 08 04:57:50.566788 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:50.566710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:50.957295 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:50.957201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:51.361123 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.361092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:51.464411 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.464374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:51.564301 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.564269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:51.632133 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.632048    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:57:51.632359 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.632333    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" podUID="747b6518-4bb0-47a4-b3c0-12a8191eca89" containerName="maas-api" containerID="cri-o://a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135" gracePeriod=30
Jul 08 04:57:51.657797 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.657772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:51.862848 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.862825    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:57:51.989534 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.989504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") pod \"747b6518-4bb0-47a4-b3c0-12a8191eca89\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") "
Jul 08 04:57:51.989712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.989541    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca\") pod \"747b6518-4bb0-47a4-b3c0-12a8191eca89\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") "
Jul 08 04:57:51.989712 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.989572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kx6t\" (UniqueName: \"kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t\") pod \"747b6518-4bb0-47a4-b3c0-12a8191eca89\" (UID: \"747b6518-4bb0-47a4-b3c0-12a8191eca89\") "
Jul 08 04:57:51.990023 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.989992    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "747b6518-4bb0-47a4-b3c0-12a8191eca89" (UID: "747b6518-4bb0-47a4-b3c0-12a8191eca89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:57:51.991698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.991675    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "747b6518-4bb0-47a4-b3c0-12a8191eca89" (UID: "747b6518-4bb0-47a4-b3c0-12a8191eca89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:57:51.991698 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:51.991683    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t" (OuterVolumeSpecName: "kube-api-access-7kx6t") pod "747b6518-4bb0-47a4-b3c0-12a8191eca89" (UID: "747b6518-4bb0-47a4-b3c0-12a8191eca89"). InnerVolumeSpecName "kube-api-access-7kx6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:52.090463 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.090435    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747b6518-4bb0-47a4-b3c0-12a8191eca89-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:52.090463 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.090459    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747b6518-4bb0-47a4-b3c0-12a8191eca89-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:52.090463 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.090469    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kx6t\" (UniqueName: \"kubernetes.io/projected/747b6518-4bb0-47a4-b3c0-12a8191eca89-kube-api-access-7kx6t\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:52.624321 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.624288    2562 generic.go:356] "Generic (PLEG): container finished" podID="747b6518-4bb0-47a4-b3c0-12a8191eca89" containerID="a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135" exitCode=0
Jul 08 04:57:52.624722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.624328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" event={"ID":"747b6518-4bb0-47a4-b3c0-12a8191eca89","Type":"ContainerDied","Data":"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"}
Jul 08 04:57:52.624722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.624339    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"
Jul 08 04:57:52.624722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.624364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj" event={"ID":"747b6518-4bb0-47a4-b3c0-12a8191eca89","Type":"ContainerDied","Data":"807ff038473daee41c84696ae74232eb523d0ddc0e773191e75ebad4caa20a74"}
Jul 08 04:57:52.624722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.624385    2562 scope.go:117] "RemoveContainer" containerID="a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"
Jul 08 04:57:52.633614 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.633431    2562 scope.go:117] "RemoveContainer" containerID="a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"
Jul 08 04:57:52.633716 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:52.633695    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135\": container with ID starting with a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135 not found: ID does not exist" containerID="a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"
Jul 08 04:57:52.633759 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.633726    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135"} err="failed to get container status \"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135\": rpc error: code = NotFound desc = could not find container \"a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135\": container with ID starting with a787c5108d37c6035fe01cdc09148ba99369405fc2750cb1232533b016023135 not found: ID does not exist"
Jul 08 04:57:52.645531 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.645506    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:57:52.651088 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:52.651065    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76a8b4-7569b5754c-km2gj"]
Jul 08 04:57:53.729367 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:53.729337    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="747b6518-4bb0-47a4-b3c0-12a8191eca89" path="/var/lib/kubelet/pods/747b6518-4bb0-47a4-b3c0-12a8191eca89/volumes"
Jul 08 04:57:55.800140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.800113    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:57:55.928293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928189    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928267    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928293 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928315    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6tbp\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928426    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928452    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket\") pod \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\" (UID: \"e750fd06-bca4-4e9e-bef0-1630c9a1d749\") "
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928539    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:55.928637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928554    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:55.929057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928689    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:55.929057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928707    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:55.929057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928824    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:55.929057 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.928927    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:57:55.929456 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.929434    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data" (OuterVolumeSpecName: "istio-data") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:55.930676 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.930648    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp" (OuterVolumeSpecName: "kube-api-access-r6tbp") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "kube-api-access-r6tbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:55.930796 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.930772    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token" (OuterVolumeSpecName: "istio-token") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:57:55.931075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.931051    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:57:55.931162 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:55.931058    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e750fd06-bca4-4e9e-bef0-1630c9a1d749" (UID: "e750fd06-bca4-4e9e-bef0-1630c9a1d749"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:57:56.029996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.029959    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.029996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.029986    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6tbp\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-kube-api-access-r6tbp\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.029996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.029997    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.029996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.030005    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.029996 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.030012    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.030297 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.030020    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e750fd06-bca4-4e9e-bef0-1630c9a1d749-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.030297 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.030027    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e750fd06-bca4-4e9e-bef0-1630c9a1d749-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:57:56.647518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.647473    2562 generic.go:356] "Generic (PLEG): container finished" podID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerID="63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43" exitCode=0
Jul 08 04:57:56.647717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.647539    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"
Jul 08 04:57:56.647717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.647558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerDied","Data":"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"}
Jul 08 04:57:56.647717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.647645    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm" event={"ID":"e750fd06-bca4-4e9e-bef0-1630c9a1d749","Type":"ContainerDied","Data":"5b1649a1e2689fea876606f11a79b6dce57ac0b507e1248040e1de8bcbda6bc1"}
Jul 08 04:57:56.647717 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.647670    2562 scope.go:117] "RemoveContainer" containerID="63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"
Jul 08 04:57:56.656792 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.656773    2562 scope.go:117] "RemoveContainer" containerID="95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"
Jul 08 04:57:56.664875 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.664681    2562 scope.go:117] "RemoveContainer" containerID="63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"
Jul 08 04:57:56.665002 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:56.664980    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43\": container with ID starting with 63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43 not found: ID does not exist" containerID="63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"
Jul 08 04:57:56.665074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.665017    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43"} err="failed to get container status \"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43\": rpc error: code = NotFound desc = could not find container \"63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43\": container with ID starting with 63180b7e6c6273aa938227fa5050cff37051255349ee4752d9c511cdfabbbb43 not found: ID does not exist"
Jul 08 04:57:56.665074 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.665043    2562 scope.go:117] "RemoveContainer" containerID="95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"
Jul 08 04:57:56.665276 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:57:56.665259    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158\": container with ID starting with 95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158 not found: ID does not exist" containerID="95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"
Jul 08 04:57:56.665330 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.665284    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158"} err="failed to get container status \"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158\": rpc error: code = NotFound desc = could not find container \"95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158\": container with ID starting with 95becc23e1915c7a9bbf7121ff08c1650733f8c1252c69a2126bd9fb8ec26158 not found: ID does not exist"
Jul 08 04:57:56.669261 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.669239    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:57:56.675426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:56.675403    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f87c81-openshift-default-858548d8b7-p6mdm"]
Jul 08 04:57:57.161244 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:57.161209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:57.261992 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:57.261959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:57.406814 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:57.406783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:57.731693 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:57.731659    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" path="/var/lib/kubelet/pods/e750fd06-bca4-4e9e-bef0-1630c9a1d749/volumes"
Jul 08 04:57:57.962400 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:57.962370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:58.235579 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235546    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235912    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235925    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235938    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" containerName="maas-api"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235943    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" containerName="maas-api"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235949    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235956    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235970    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235975    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235984    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747b6518-4bb0-47a4-b3c0-12a8191eca89" containerName="maas-api"
Jul 08 04:57:58.235983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.235989    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="747b6518-4bb0-47a4-b3c0-12a8191eca89" containerName="maas-api"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236043    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236052    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236060    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236066    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e750fd06-bca4-4e9e-bef0-1630c9a1d749" containerName="istio-proxy"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236071    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="747b6518-4bb0-47a4-b3c0-12a8191eca89" containerName="maas-api"
Jul 08 04:57:58.236319 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.236077    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c8ce53c-10e7-4305-9ea1-33fb5035a481" containerName="maas-api"
Jul 08 04:57:58.240334 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.240318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.242774 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.242755    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-284d57-openshift-default-dockercfg-kh94g\""
Jul 08 04:57:58.249715 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.249691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:57:58.262718 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.262687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:58.351001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.350972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351001 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351378 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds456\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.351378 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.351292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452283 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds456\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452550 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.452746 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.453156 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.452957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.453156 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.453065    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.453365 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.453343    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.454913 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.454894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.455147 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.455128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.460480 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.460454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds456\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.460648 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.460630    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token\") pod \"e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") " pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.551270 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.551181    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:57:58.596659 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.596624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:57:58.686747 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.686723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:57:58.688542 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:57:58.688511    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85affaae_305b_4842_9816_0ca859290f9e.slice/crio-17609082fe5be2b479415cc907a924cd51c85d55c8c229d2e9bfda4a90d58f63 WatchSource:0}: Error finding container 17609082fe5be2b479415cc907a924cd51c85d55c8c229d2e9bfda4a90d58f63: Status 404 returned error can't find the container with id 17609082fe5be2b479415cc907a924cd51c85d55c8c229d2e9bfda4a90d58f63
Jul 08 04:57:58.690540 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.690511    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:57:58.690616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.690575    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:57:58.690616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:58.690602    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:57:59.667050 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:59.667017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerStarted","Data":"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"}
Jul 08 04:57:59.667459 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:59.667079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerStarted","Data":"17609082fe5be2b479415cc907a924cd51c85d55c8c229d2e9bfda4a90d58f63"}
Jul 08 04:57:59.687197 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:57:59.687097    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podStartSLOduration=1.6870777380000002 podStartE2EDuration="1.687077738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:57:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:57:59.685778979 +0000 UTC m=+2370.606407493" watchObservedRunningTime="2026-07-08 04:57:59.687077738 +0000 UTC m=+2370.607706210"
Jul 08 04:58:00.551796 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:00.551758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:00.556666 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:00.556641    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:00.672420 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:00.672375    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:00.673339 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:00.673317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:01.581006 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.580975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:01.681503 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.681466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:01.777771 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.777735    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:01.778229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.778208    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:58:01.778229 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.778230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e4b85e-e7a7-4127-866c-dba8f9d45baa" containerName="istio-proxy"
Jul 08 04:58:01.781145 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.781122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.783686 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.783664    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-284d57-serving-cert\""
Jul 08 04:58:01.791909 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.791887    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:01.811067 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.811036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:01.882377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.882277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jnd\" (UniqueName: \"kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.882377 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.882336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.882626 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.882605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.983232 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.983173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.983438 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.983342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jnd\" (UniqueName: \"kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.983438 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.983403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.983551 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:01.983526    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-serving-cert: secret "maas-api-e2e-api-a-284d57-serving-cert" not found
Jul 08 04:58:01.983603 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:01.983592    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls podName:da6ab213-e7e8-44b6-9314-a553bf1cb6ea nodeName:}" failed. No retries permitted until 2026-07-08 04:58:02.483574846 +0000 UTC m=+2373.404203297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls") pod "maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" (UID: "da6ab213-e7e8-44b6-9314-a553bf1cb6ea") : secret "maas-api-e2e-api-a-284d57-serving-cert" not found
Jul 08 04:58:01.983815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.983795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:01.992364 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:01.992342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jnd\" (UniqueName: \"kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:02.141714 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.141622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:02.430914 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.430813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:02.487982 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.487936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:02.490353 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.490330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") pod \"maas-api-e2e-api-a-284d57-68bd699dfc-jjzws\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:02.534042 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.534010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:02.693120 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.693037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:02.833255 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.833225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:02.834834 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:58:02.834806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6ab213_e7e8_44b6_9314_a553bf1cb6ea.slice/crio-2b512fe0096157974399fdfc5b3d1200fbea19d932938082d81e7fdc578a5ed5 WatchSource:0}: Error finding container 2b512fe0096157974399fdfc5b3d1200fbea19d932938082d81e7fdc578a5ed5: Status 404 returned error can't find the container with id 2b512fe0096157974399fdfc5b3d1200fbea19d932938082d81e7fdc578a5ed5
Jul 08 04:58:02.836386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:02.836368    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 04:58:03.689262 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:03.689161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" event={"ID":"da6ab213-e7e8-44b6-9314-a553bf1cb6ea","Type":"ContainerStarted","Data":"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"}
Jul 08 04:58:03.689262 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:03.689224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" event={"ID":"da6ab213-e7e8-44b6-9314-a553bf1cb6ea","Type":"ContainerStarted","Data":"2b512fe0096157974399fdfc5b3d1200fbea19d932938082d81e7fdc578a5ed5"}
Jul 08 04:58:03.689452 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:03.689343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:03.709758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:03.709697    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" podStartSLOduration=2.208768364 podStartE2EDuration="2.70968174s" totalImagesPullingTime="500.913376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:58:03.706606119 +0000 UTC m=+2374.627234609" watchObservedRunningTime="2026-07-08 04:58:03.70968174 +0000 UTC m=+2374.630310213"
Jul 08 04:58:06.082834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.082792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:06.547836 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.547802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:06.824539 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.824459    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:06.828149 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.828125    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.830701 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.830670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7f2f6e-openshift-default-dockercfg-m9kqr\""
Jul 08 04:58:06.841078 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.841050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:06.854195 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.854160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:06.929489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929489 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qkb\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.929765 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.930065 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:06.930065 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:06.929820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030633 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030633 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qkb\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.030945 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.030885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.031318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.031140    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.031318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.031201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.031423 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.031358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.031656 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.031637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.031854 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.031821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.033616 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.033590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.033850 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.033828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.038167 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.038139    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.038406 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.038387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qkb\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb\") pod \"e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") " pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.139713 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.139618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:07.246918 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.246886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:07.277605 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.277574    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:07.278820 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:58:07.278796    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e362362_d0ef_4b5c_996c_069197b723a4.slice/crio-7e6e5366e3263929a5ba2a4931ec393a5f341b00683cec1128d48d5d437a4b7a WatchSource:0}: Error finding container 7e6e5366e3263929a5ba2a4931ec393a5f341b00683cec1128d48d5d437a4b7a: Status 404 returned error can't find the container with id 7e6e5366e3263929a5ba2a4931ec393a5f341b00683cec1128d48d5d437a4b7a
Jul 08 04:58:07.281105 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.281066    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:07.281182 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.281154    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:07.281227 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.281202    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:07.711918 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.711879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerStarted","Data":"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"}
Jul 08 04:58:07.712127 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.711929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerStarted","Data":"7e6e5366e3263929a5ba2a4931ec393a5f341b00683cec1128d48d5d437a4b7a"}
Jul 08 04:58:07.732415 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:07.732360    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podStartSLOduration=1.732344597 podStartE2EDuration="1.732344597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:58:07.731082165 +0000 UTC m=+2378.651710687" watchObservedRunningTime="2026-07-08 04:58:07.732344597 +0000 UTC m=+2378.652973071"
Jul 08 04:58:08.140512 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:08.140459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:08.156752 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:08.156716    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:08.717327 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:08.717301    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:08.718277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:08.718257    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:09.635201 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:09.635168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:09.700021 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:09.699995    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:09.763886 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:09.762792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:09.960118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:09.960023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:10.345932 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:10.345898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:10.552251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:10.552217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:10.655755 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:10.655674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:14.114351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:14.114318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:15.674315 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.674282    2562 patch_prober.go:28] interesting pod/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 04:58:15.674832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.674350    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 04:58:15.770813 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.770782    2562 generic.go:356] "Generic (PLEG): container finished" podID="85affaae-305b-4842-9816-0ca859290f9e" containerID="e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391" exitCode=0
Jul 08 04:58:15.770994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.770841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerDied","Data":"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"}
Jul 08 04:58:15.771265 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.771251    2562 scope.go:117] "RemoveContainer" containerID="e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"
Jul 08 04:58:15.772259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.772227    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:15.772376 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.772306    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:15.772376 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:15.772345    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:16.777637 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:16.777602    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerStarted","Data":"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"}
Jul 08 04:58:17.551895 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:17.551840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:17.552304 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:17.552216    2562 patch_prober.go:28] interesting pod/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 04:58:17.552501 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:17.552477    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 04:58:18.551722 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:18.551681    2562 patch_prober.go:28] interesting pod/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 04:58:18.552350 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:18.552317    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 04:58:19.552211 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:19.552165    2562 patch_prober.go:28] interesting pod/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 04:58:19.552725 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:19.552248    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 04:58:20.552333 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:20.552288    2562 patch_prober.go:28] interesting pod/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 08 04:58:20.552971 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:20.552934    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 08 04:58:21.557389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:21.557355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:21.557789 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:21.557769    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:21.558620 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:21.558602    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:22.200017 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.199978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:22.543799 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.543743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:22.643344 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.643301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:22.744404 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.744371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:22.893425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.893341    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:22.893627 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.893600    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" podUID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" containerName="maas-api" containerID="cri-o://5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463" gracePeriod=30
Jul 08 04:58:22.926084 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:22.926028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:23.187931 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.187907    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:23.300805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.300774    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4jnd\" (UniqueName: \"kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd\") pod \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") "
Jul 08 04:58:23.301016 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.300943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") pod \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") "
Jul 08 04:58:23.301016 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.300995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca\") pod \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\" (UID: \"da6ab213-e7e8-44b6-9314-a553bf1cb6ea\") "
Jul 08 04:58:23.301361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.301335    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da6ab213-e7e8-44b6-9314-a553bf1cb6ea" (UID: "da6ab213-e7e8-44b6-9314-a553bf1cb6ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:58:23.303041 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.303010    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd" (OuterVolumeSpecName: "kube-api-access-t4jnd") pod "da6ab213-e7e8-44b6-9314-a553bf1cb6ea" (UID: "da6ab213-e7e8-44b6-9314-a553bf1cb6ea"). InnerVolumeSpecName "kube-api-access-t4jnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:58:23.303140 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.303085    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da6ab213-e7e8-44b6-9314-a553bf1cb6ea" (UID: "da6ab213-e7e8-44b6-9314-a553bf1cb6ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 04:58:23.402208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.402170    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:23.402208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.402205    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:23.402208 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.402216    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4jnd\" (UniqueName: \"kubernetes.io/projected/da6ab213-e7e8-44b6-9314-a553bf1cb6ea-kube-api-access-t4jnd\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:23.818811 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.818778    2562 generic.go:356] "Generic (PLEG): container finished" podID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" containerID="5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463" exitCode=0
Jul 08 04:58:23.819269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.818835    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"
Jul 08 04:58:23.819269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.818885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" event={"ID":"da6ab213-e7e8-44b6-9314-a553bf1cb6ea","Type":"ContainerDied","Data":"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"}
Jul 08 04:58:23.819269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.818944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws" event={"ID":"da6ab213-e7e8-44b6-9314-a553bf1cb6ea","Type":"ContainerDied","Data":"2b512fe0096157974399fdfc5b3d1200fbea19d932938082d81e7fdc578a5ed5"}
Jul 08 04:58:23.819269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.818974    2562 scope.go:117] "RemoveContainer" containerID="5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"
Jul 08 04:58:23.829809 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.829779    2562 scope.go:117] "RemoveContainer" containerID="5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"
Jul 08 04:58:23.830233 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:23.830204    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463\": container with ID starting with 5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463 not found: ID does not exist" containerID="5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"
Jul 08 04:58:23.830330 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.830243    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463"} err="failed to get container status \"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463\": rpc error: code = NotFound desc = could not find container \"5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463\": container with ID starting with 5c71df313fd183a447044c6a7dcee26ec700568b9fb6dd609a1562ae1f284463 not found: ID does not exist"
Jul 08 04:58:23.837953 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.837910    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:23.840477 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:23.840449    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-284d57-68bd699dfc-jjzws"]
Jul 08 04:58:24.759096 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:24.759055    2562 patch_prober.go:28] interesting pod/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 04:58:24.759280 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:24.759142    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 04:58:25.729426 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:25.729390    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" path="/var/lib/kubelet/pods/da6ab213-e7e8-44b6-9314-a553bf1cb6ea/volumes"
Jul 08 04:58:26.838674 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.838635    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e362362-d0ef-4b5c-996c-069197b723a4" containerID="d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402" exitCode=0
Jul 08 04:58:26.839145 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.838703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerDied","Data":"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"}
Jul 08 04:58:26.839194 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.839144    2562 scope.go:117] "RemoveContainer" containerID="d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"
Jul 08 04:58:26.840146 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.840115    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:26.840259 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.840201    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:26.840325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:26.840262    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:27.850983 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:27.850940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerStarted","Data":"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"}
Jul 08 04:58:28.140915 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.140784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:28.141308 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.141218    2562 patch_prober.go:28] interesting pod/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 04:58:28.141468 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.141444    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 04:58:28.231684 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.231650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:28.294146 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.294104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:28.469374 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.469274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:58:28.469563 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.469531    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy" containerID="cri-o://ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c" gracePeriod=30
Jul 08 04:58:28.480993 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.480967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:28.921325 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:28.921295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:29.140933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.140419    2562 patch_prober.go:28] interesting pod/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 04:58:29.140933 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.140495    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 04:58:29.258318 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.258273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:29.603279 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.603180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:29.704358 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.704324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:29.773706 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.773675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:58:29.781326 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.781302    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-143-106.ec2.internal_eefaa663ec39fc89d19e48763868a1f4/kube-rbac-proxy-crio/2.log"
Jul 08 04:58:29.882425 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:29.882398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:30.141087 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:30.141000    2562 patch_prober.go:28] interesting pod/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 04:58:30.141666 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:30.141632    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 04:58:31.140570 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:31.140531    2562 patch_prober.go:28] interesting pod/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 08 04:58:31.140954 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:31.140920    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 08 04:58:32.143935 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:32.143903    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:32.144370 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:32.144303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:32.145047 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:32.145030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:33.731107 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.731080    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:33.799171 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799171 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799137    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds456\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799193    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799214    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799242    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799320    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799409 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799392    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:33.799735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket\") pod \"85affaae-305b-4842-9816-0ca859290f9e\" (UID: \"85affaae-305b-4842-9816-0ca859290f9e\") "
Jul 08 04:58:33.799735 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799694    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:33.799912 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799894    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.799979 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799914    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.799979 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799938    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:33.800092 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.799970    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:58:33.800092 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.800010    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data" (OuterVolumeSpecName: "istio-data") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:33.801567 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.801540    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:58:33.801567 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.801557    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:33.801754 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.801563    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456" (OuterVolumeSpecName: "kube-api-access-ds456") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "kube-api-access-ds456". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:58:33.801754 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.801613    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "85affaae-305b-4842-9816-0ca859290f9e" (UID: "85affaae-305b-4842-9816-0ca859290f9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:58:33.890736 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.890701    2562 generic.go:356] "Generic (PLEG): container finished" podID="85affaae-305b-4842-9816-0ca859290f9e" containerID="ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c" exitCode=0
Jul 08 04:58:33.890959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.890756    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"
Jul 08 04:58:33.890959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.890786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerDied","Data":"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"}
Jul 08 04:58:33.890959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.890840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw" event={"ID":"85affaae-305b-4842-9816-0ca859290f9e","Type":"ContainerDied","Data":"17609082fe5be2b479415cc907a924cd51c85d55c8c229d2e9bfda4a90d58f63"}
Jul 08 04:58:33.890959 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.890880    2562 scope.go:117] "RemoveContainer" containerID="ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"
Jul 08 04:58:33.900417 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900400    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds456\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-kube-api-access-ds456\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900419    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85affaae-305b-4842-9816-0ca859290f9e-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900429    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85affaae-305b-4842-9816-0ca859290f9e-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900437    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900445    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85affaae-305b-4842-9816-0ca859290f9e-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900454    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900504 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900461    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85affaae-305b-4842-9816-0ca859290f9e-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:33.900758 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.900699    2562 scope.go:117] "RemoveContainer" containerID="e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"
Jul 08 04:58:33.909381 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.909359    2562 scope.go:117] "RemoveContainer" containerID="ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"
Jul 08 04:58:33.909643 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:33.909626    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c\": container with ID starting with ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c not found: ID does not exist" containerID="ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"
Jul 08 04:58:33.909688 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.909652    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c"} err="failed to get container status \"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c\": rpc error: code = NotFound desc = could not find container \"ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c\": container with ID starting with ebb91b18cbf07744ab60ba586bf53ae286215644e38ee9b07881bebefe69838c not found: ID does not exist"
Jul 08 04:58:33.909688 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.909669    2562 scope.go:117] "RemoveContainer" containerID="e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"
Jul 08 04:58:33.909943 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:33.909923    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391\": container with ID starting with e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391 not found: ID does not exist" containerID="e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"
Jul 08 04:58:33.909991 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.909949    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391"} err="failed to get container status \"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391\": rpc error: code = NotFound desc = could not find container \"e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391\": container with ID starting with e62edd2ae15b9b507fe344a146ad8a6656b9e3c0f633b1e491b92499c085c391 not found: ID does not exist"
Jul 08 04:58:33.915337 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.915314    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:58:33.919652 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:33.919631    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-284d57-openshift-default-69544fccbc-zt8lw"]
Jul 08 04:58:34.833340 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:34.833311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:34.933500 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:34.933458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:35.069798 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.069762    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:35.070081 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.070053    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy" containerID="cri-o://66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f" gracePeriod=30
Jul 08 04:58:35.092899 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.092796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:35.652103 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.652071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:35.728346 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.728314    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85affaae-305b-4842-9816-0ca859290f9e" path="/var/lib/kubelet/pods/85affaae-305b-4842-9816-0ca859290f9e/volumes"
Jul 08 04:58:35.929832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.929746    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 04:58:35.930343 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930321    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:35.930389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930347    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:35.930389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930376    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" containerName="maas-api"
Jul 08 04:58:35.930389 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930384    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" containerName="maas-api"
Jul 08 04:58:35.930496 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930484    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:35.930534 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930502    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6ab213-e7e8-44b6-9314-a553bf1cb6ea" containerName="maas-api"
Jul 08 04:58:35.930534 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.930511    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:35.932937 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.932918    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:35.935507 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.935488    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-83995d-openshift-default-dockercfg-blzf2\""
Jul 08 04:58:35.945275 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.945252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 04:58:35.955418 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:35.955395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:36.020606 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.020800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.020800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.020800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.020800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzhp\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.020800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.021024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.021024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.021024 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.020921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.059924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.059883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:36.122044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122044 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzhp\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122274 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122631 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.122902 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122874    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.123059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.123059 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.122927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.124451 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.124430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.124587 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.124569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.130269 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.130245    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.130651 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.130628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzhp\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp\") pod \"e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") " pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.244725 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.244690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:36.383834 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.383802    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 04:58:36.384791 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:58:36.384764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1c7a43_f28f_46b4_a068_22caa997db3b.slice/crio-7748f6b7c8dd27028a5aa90302e9881168cc37c5c18b0483e78b96b41064ec51 WatchSource:0}: Error finding container 7748f6b7c8dd27028a5aa90302e9881168cc37c5c18b0483e78b96b41064ec51: Status 404 returned error can't find the container with id 7748f6b7c8dd27028a5aa90302e9881168cc37c5c18b0483e78b96b41064ec51
Jul 08 04:58:36.387113 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.387072    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:36.387193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.387143    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:36.387193 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.387176    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:36.911173 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.911135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerStarted","Data":"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"}
Jul 08 04:58:36.911390 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.911193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerStarted","Data":"7748f6b7c8dd27028a5aa90302e9881168cc37c5c18b0483e78b96b41064ec51"}
Jul 08 04:58:36.930433 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:36.930384    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podStartSLOduration=1.930367046 podStartE2EDuration="1.930367046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:58:36.928814435 +0000 UTC m=+2407.849442922" watchObservedRunningTime="2026-07-08 04:58:36.930367046 +0000 UTC m=+2407.850995518"
Jul 08 04:58:37.245529 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:37.245491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:37.250650 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:37.250627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:37.916575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:37.916542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:37.917439 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:37.917417    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:38.819187 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:38.819156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:38.909049 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:38.909022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:39.015815 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:39.015783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:39.559992 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:39.559960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:39.659924 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:39.659886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:40.331050 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.330981    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:40.462114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462073    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462114 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462121    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462165    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462187    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462226    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462298    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462351 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462334    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2qkb\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462379    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data\") pod \"8e362362-d0ef-4b5c-996c-069197b723a4\" (UID: \"8e362362-d0ef-4b5c-996c-069197b723a4\") "
Jul 08 04:58:40.462669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462447    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:40.462669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462588    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:40.462669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462623    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:40.462897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462743    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 04:58:40.462897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462762    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.462897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462783    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.462897 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.462797    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.463336 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.463314    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:40.464575 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.464546    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 04:58:40.464683 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.464581    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb" (OuterVolumeSpecName: "kube-api-access-b2qkb") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "kube-api-access-b2qkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:58:40.464843 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.464820    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 04:58:40.464843 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.464821    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e362362-d0ef-4b5c-996c-069197b723a4" (UID: "8e362362-d0ef-4b5c-996c-069197b723a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 04:58:40.564225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564173    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.564225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564223    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e362362-d0ef-4b5c-996c-069197b723a4-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.564225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564234    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.564225 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564244    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e362362-d0ef-4b5c-996c-069197b723a4-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.564516 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564253    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2qkb\" (UniqueName: \"kubernetes.io/projected/8e362362-d0ef-4b5c-996c-069197b723a4-kube-api-access-b2qkb\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.564516 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.564262    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e362362-d0ef-4b5c-996c-069197b723a4-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 04:58:40.934516 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.934483    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e362362-d0ef-4b5c-996c-069197b723a4" containerID="66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f" exitCode=0
Jul 08 04:58:40.934685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.934548    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"
Jul 08 04:58:40.934685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.934564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerDied","Data":"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"}
Jul 08 04:58:40.934685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.934619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj" event={"ID":"8e362362-d0ef-4b5c-996c-069197b723a4","Type":"ContainerDied","Data":"7e6e5366e3263929a5ba2a4931ec393a5f341b00683cec1128d48d5d437a4b7a"}
Jul 08 04:58:40.934685 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.934642    2562 scope.go:117] "RemoveContainer" containerID="66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"
Jul 08 04:58:40.943995 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.943978    2562 scope.go:117] "RemoveContainer" containerID="d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"
Jul 08 04:58:40.951923 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.951903    2562 scope.go:117] "RemoveContainer" containerID="66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"
Jul 08 04:58:40.952215 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:40.952193    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f\": container with ID starting with 66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f not found: ID does not exist" containerID="66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"
Jul 08 04:58:40.952314 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.952221    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f"} err="failed to get container status \"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f\": rpc error: code = NotFound desc = could not find container \"66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f\": container with ID starting with 66487465940a5674858a6f68ae16cac18e2466d7c5cacb915799e82356f3da1f not found: ID does not exist"
Jul 08 04:58:40.952314 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.952237    2562 scope.go:117] "RemoveContainer" containerID="d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"
Jul 08 04:58:40.952538 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:40.952518    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402\": container with ID starting with d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402 not found: ID does not exist" containerID="d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"
Jul 08 04:58:40.952592 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.952543    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402"} err="failed to get container status \"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402\": rpc error: code = NotFound desc = could not find container \"d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402\": container with ID starting with d9ff6f7d648bc1f7d6d6d7d24b5bac331bf4f581affa1ddd3a1a1758466a5402 not found: ID does not exist"
Jul 08 04:58:40.956251 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.956231    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:40.959947 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:40.959919    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7f2f6e-openshift-default-54b84ff48f-6nsgj"]
Jul 08 04:58:41.729180 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:41.729148    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" path="/var/lib/kubelet/pods/8e362362-d0ef-4b5c-996c-069197b723a4/volumes"
Jul 08 04:58:43.304728 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:43.304662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:43.625203 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:43.625103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:43.935331 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:43.935224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:44.367075 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:44.367043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:46.681161 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.681123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:46.756564 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.756525    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 04:58:46.756955 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.756935    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:46.757357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.756974    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="85affaae-305b-4842-9816-0ca859290f9e" containerName="istio-proxy"
Jul 08 04:58:46.757357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.756992    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 04:58:46.757357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.757000    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 04:58:46.757357 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.757168    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 04:58:46.760748 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.760727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:46.763386 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.763365    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bd94ec-serving-cert\""
Jul 08 04:58:46.770474 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.770453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 04:58:46.787226 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.787190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:46.896342 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.896313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:46.923849 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.923816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2x2\" (UniqueName: \"kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:46.924034 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.923956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:46.924034 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:46.924019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.025483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.025443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.025669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.025499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.025669 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.025536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2x2\" (UniqueName: \"kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.025743 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:47.025668    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-serving-cert: secret "maas-api-e2e-shared-b-bd94ec-serving-cert" not found
Jul 08 04:58:47.025743 ip-10-0-143-106 kubenswrapper[2562]: E0708 04:58:47.025730    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls podName:ec9ac2c2-e43f-4d47-a889-fae417e7e393 nodeName:}" failed. No retries permitted until 2026-07-08 04:58:47.525714073 +0000 UTC m=+2418.446342524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls") pod "maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" (UID: "ec9ac2c2-e43f-4d47-a889-fae417e7e393") : secret "maas-api-e2e-shared-b-bd94ec-serving-cert" not found
Jul 08 04:58:47.026258 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.026234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.042536 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.042505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2x2\" (UniqueName: \"kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.227222 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.227188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:47.358119 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.358030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:47.460118 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.460085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:47.530185 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.530126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.534560 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.534524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") pod \"maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.674530 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.674442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:47.755518 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.755486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:47.855849 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.855812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 04:58:47.861898 ip-10-0-143-106 kubenswrapper[2562]: W0708 04:58:47.861842    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9ac2c2_e43f_4d47_a889_fae417e7e393.slice/crio-9acf1ae15273d602286c6a65619c62faa222f2fd81c6dc80a257b5ea1bac53fa WatchSource:0}: Error finding container 9acf1ae15273d602286c6a65619c62faa222f2fd81c6dc80a257b5ea1bac53fa: Status 404 returned error can't find the container with id 9acf1ae15273d602286c6a65619c62faa222f2fd81c6dc80a257b5ea1bac53fa
Jul 08 04:58:47.973070 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:47.973045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" event={"ID":"ec9ac2c2-e43f-4d47-a889-fae417e7e393","Type":"ContainerStarted","Data":"9acf1ae15273d602286c6a65619c62faa222f2fd81c6dc80a257b5ea1bac53fa"}
Jul 08 04:58:48.979805 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:48.979773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" event={"ID":"ec9ac2c2-e43f-4d47-a889-fae417e7e393","Type":"ContainerStarted","Data":"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"}
Jul 08 04:58:48.980288 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:48.979880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:48.996615 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:48.996566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" podStartSLOduration=2.658795204 podStartE2EDuration="2.996526272s" totalImagesPullingTime="337.731068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 04:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 04:58:48.996341269 +0000 UTC m=+2419.916969742" watchObservedRunningTime="2026-07-08 04:58:48.996526272 +0000 UTC m=+2419.917154745"
Jul 08 04:58:51.137733 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:51.137638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:53.960085 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:53.960036    2562 patch_prober.go:28] interesting pod/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 04:58:53.960449 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:53.960114    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 04:58:54.990697 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:54.990665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 04:58:55.014277 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.014246    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerID="9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e" exitCode=0
Jul 08 04:58:55.014441 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.014318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerDied","Data":"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"}
Jul 08 04:58:55.014713 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.014697    2562 scope.go:117] "RemoveContainer" containerID="9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"
Jul 08 04:58:55.015800 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.015766    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:55.015930 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.015876    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:55.015994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:55.015928    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 04:58:56.022361 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:56.022329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerStarted","Data":"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"}
Jul 08 04:58:56.246091 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:56.246046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:58:56.246311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:56.246221    2562 patch_prober.go:28] interesting pod/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 04:58:56.246311 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:56.246268    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 04:58:57.245832 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:57.245786    2562 patch_prober.go:28] interesting pod/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 04:58:57.246354 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:57.245900    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 04:58:58.245812 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:58.245772    2562 patch_prober.go:28] interesting pod/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 04:58:58.246196 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:58.246154    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 04:58:58.758310 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:58.758280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:58:59.246400 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:59.245665    2562 patch_prober.go:28] interesting pod/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 08 04:58:59.246400 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:58:59.245743    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 08 04:59:00.249000 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:00.248964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:59:00.249483 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:00.249358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:59:00.250174 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:00.250153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 04:59:00.305994 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:00.305958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:59:00.407210 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:00.407181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:59:08.181033 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:08.180967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 04:59:08.282207 ip-10-0-143-106 kubenswrapper[2562]: I0708 04:59:08.282178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:01:56.028502 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:01:56.028418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:01:57.455178 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:01:57.455138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:02.185559 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.185524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:02.282672 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.282634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:02.485616 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.485586    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 05:02:02.485815 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.485799    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy" containerID="cri-o://be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387" gracePeriod=30
Jul 08 05:02:02.489281 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.489243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:02.865547 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:02.865454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:03.243288 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.243252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:03.402404 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.402368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:03.500643 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.500550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:03.606665 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.606634    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 05:02:03.606933 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.606905    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" podUID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" containerName="maas-api" containerID="cri-o://4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31" gracePeriod=30
Jul 08 05:02:03.630813 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.630777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:03.861680 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.861658    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 05:02:03.994398 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.994364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") pod \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") "
Jul 08 05:02:03.994570 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.994493    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca\") pod \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") "
Jul 08 05:02:03.994570 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.994533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m2x2\" (UniqueName: \"kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2\") pod \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\" (UID: \"ec9ac2c2-e43f-4d47-a889-fae417e7e393\") "
Jul 08 05:02:03.994946 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.994920    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec9ac2c2-e43f-4d47-a889-fae417e7e393" (UID: "ec9ac2c2-e43f-4d47-a889-fae417e7e393"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 05:02:03.996540 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.996515    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec9ac2c2-e43f-4d47-a889-fae417e7e393" (UID: "ec9ac2c2-e43f-4d47-a889-fae417e7e393"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 05:02:03.996604 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:03.996549    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2" (OuterVolumeSpecName: "kube-api-access-6m2x2") pod "ec9ac2c2-e43f-4d47-a889-fae417e7e393" (UID: "ec9ac2c2-e43f-4d47-a889-fae417e7e393"). InnerVolumeSpecName "kube-api-access-6m2x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 05:02:04.011157 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.011129    2562 generic.go:356] "Generic (PLEG): container finished" podID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" containerID="4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31" exitCode=0
Jul 08 05:02:04.011297 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.011175    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"
Jul 08 05:02:04.011297 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.011210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" event={"ID":"ec9ac2c2-e43f-4d47-a889-fae417e7e393","Type":"ContainerDied","Data":"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"}
Jul 08 05:02:04.011297 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.011264    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m" event={"ID":"ec9ac2c2-e43f-4d47-a889-fae417e7e393","Type":"ContainerDied","Data":"9acf1ae15273d602286c6a65619c62faa222f2fd81c6dc80a257b5ea1bac53fa"}
Jul 08 05:02:04.011297 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.011288    2562 scope.go:117] "RemoveContainer" containerID="4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"
Jul 08 05:02:04.020189 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.020170    2562 scope.go:117] "RemoveContainer" containerID="4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"
Jul 08 05:02:04.020436 ip-10-0-143-106 kubenswrapper[2562]: E0708 05:02:04.020417    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31\": container with ID starting with 4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31 not found: ID does not exist" containerID="4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"
Jul 08 05:02:04.020502 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.020443    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31"} err="failed to get container status \"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31\": rpc error: code = NotFound desc = could not find container \"4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31\": container with ID starting with 4d005c3a093d2a7f2a43a723fe80f1754d308ff2aee7b0371c1eef166f4aaa31 not found: ID does not exist"
Jul 08 05:02:04.032147 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.032079    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 05:02:04.036518 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.036494    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bd94ec-987cd847d-4d59m"]
Jul 08 05:02:04.095693 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.095663    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ac2c2-e43f-4d47-a889-fae417e7e393-openshift-service-ca\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:04.095693 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.095690    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m2x2\" (UniqueName: \"kubernetes.io/projected/ec9ac2c2-e43f-4d47-a889-fae417e7e393-kube-api-access-6m2x2\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:04.095915 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:04.095707    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec9ac2c2-e43f-4d47-a889-fae417e7e393-maas-api-tls\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:05.729174 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:05.729139    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" path="/var/lib/kubelet/pods/ec9ac2c2-e43f-4d47-a889-fae417e7e393/volumes"
Jul 08 05:02:07.741540 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.741516    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 05:02:07.828588 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bzhp\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.828588 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828574    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.828828 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828652    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.828828 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.828828 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828763    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.828828 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828804    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 05:02:07.828828 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828818    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.829153 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.829153 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.829153 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828951    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token\") pod \"9a1c7a43-f28f-46b4-a068-22caa997db3b\" (UID: \"9a1c7a43-f28f-46b4-a068-22caa997db3b\") "
Jul 08 05:02:07.829153 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.828976    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 05:02:07.829354 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.829219    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 05:02:07.829354 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.829228    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-credential-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.829354 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.829310    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 05:02:07.829354 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.829340    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-certs\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.829737 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.829707    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 05:02:07.830913 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.830882    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 05:02:07.831023 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.830988    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 05:02:07.831078 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.831035    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp" (OuterVolumeSpecName: "kube-api-access-9bzhp") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "kube-api-access-9bzhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 05:02:07.831140 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.831122    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a1c7a43-f28f-46b4-a068-22caa997db3b" (UID: "9a1c7a43-f28f-46b4-a068-22caa997db3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 05:02:07.930734 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930692    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-data\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.930734 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930728    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1c7a43-f28f-46b4-a068-22caa997db3b-istiod-ca-cert\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.930734 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930737    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-envoy\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.931016 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930745    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1c7a43-f28f-46b4-a068-22caa997db3b-workload-socket\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.931016 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930757    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-token\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.931016 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930768    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bzhp\" (UniqueName: \"kubernetes.io/projected/9a1c7a43-f28f-46b4-a068-22caa997db3b-kube-api-access-9bzhp\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:07.931016 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:07.930777    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1c7a43-f28f-46b4-a068-22caa997db3b-istio-podinfo\") on node \"ip-10-0-143-106.ec2.internal\" DevicePath \"\""
Jul 08 05:02:08.041371 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.041339    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerID="be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387" exitCode=0
Jul 08 05:02:08.041545 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.041389    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"
Jul 08 05:02:08.041545 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.041428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerDied","Data":"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"}
Jul 08 05:02:08.041545 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.041494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm" event={"ID":"9a1c7a43-f28f-46b4-a068-22caa997db3b","Type":"ContainerDied","Data":"7748f6b7c8dd27028a5aa90302e9881168cc37c5c18b0483e78b96b41064ec51"}
Jul 08 05:02:08.041545 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.041527    2562 scope.go:117] "RemoveContainer" containerID="be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"
Jul 08 05:02:08.051761 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.051739    2562 scope.go:117] "RemoveContainer" containerID="9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"
Jul 08 05:02:08.060477 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.060455    2562 scope.go:117] "RemoveContainer" containerID="be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"
Jul 08 05:02:08.060790 ip-10-0-143-106 kubenswrapper[2562]: E0708 05:02:08.060767    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387\": container with ID starting with be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387 not found: ID does not exist" containerID="be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"
Jul 08 05:02:08.060835 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.060801    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387"} err="failed to get container status \"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387\": rpc error: code = NotFound desc = could not find container \"be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387\": container with ID starting with be2185781eb59a5646d60becdf2f09dcbef08dca62e08f03207ffb652d7ec387 not found: ID does not exist"
Jul 08 05:02:08.060835 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.060821    2562 scope.go:117] "RemoveContainer" containerID="9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"
Jul 08 05:02:08.061080 ip-10-0-143-106 kubenswrapper[2562]: E0708 05:02:08.061063    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e\": container with ID starting with 9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e not found: ID does not exist" containerID="9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"
Jul 08 05:02:08.061126 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.061086    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e"} err="failed to get container status \"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e\": rpc error: code = NotFound desc = could not find container \"9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e\": container with ID starting with 9d744bcbf852bc69cfffa98e420d1a11953ba91283bb644187feea995edf185e not found: ID does not exist"
Jul 08 05:02:08.064824 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.064790    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 05:02:08.070422 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.070396    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-83995d-openshift-default-747fbc666c-8zxsm"]
Jul 08 05:02:08.979710 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:08.979671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:09.079790 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:09.079751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:09.256019 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:09.255919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:09.734651 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:09.734617    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" path="/var/lib/kubelet/pods/9a1c7a43-f28f-46b4-a068-22caa997db3b/volumes"
Jul 08 05:02:14.573709 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:14.573673    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h2c8g_a9cfd22d-e7e0-42f6-b954-0db8c87bb2de/manager/0.log"
Jul 08 05:02:14.698190 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:14.698150    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55c7f6b5f9-nhq5s_34b207c4-5b64-4cdd-bc7d-ae682ee36797/manager/0.log"
Jul 08 05:02:15.028845 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:15.028816    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f76f945bd-5wx2r_d158b6ec-9010-493d-8493-f083e5ccdb01/copy-manifests/0.log"
Jul 08 05:02:15.035481 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:15.035457    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f76f945bd-5wx2r_d158b6ec-9010-493d-8493-f083e5ccdb01/manager/0.log"
Jul 08 05:02:16.070343 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.070308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/util/0.log"
Jul 08 05:02:16.076298 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.076271    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/pull/0.log"
Jul 08 05:02:16.081830 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.081807    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/extract/0.log"
Jul 08 05:02:16.191172 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.191143    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/util/0.log"
Jul 08 05:02:16.197237 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.197207    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/pull/0.log"
Jul 08 05:02:16.204247 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.204216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/extract/0.log"
Jul 08 05:02:16.313771 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.313743    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/util/0.log"
Jul 08 05:02:16.319873 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.319834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/pull/0.log"
Jul 08 05:02:16.326230 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.326159    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/extract/0.log"
Jul 08 05:02:16.437734 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.437692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/util/0.log"
Jul 08 05:02:16.443680 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.443652    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/pull/0.log"
Jul 08 05:02:16.449451 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.449424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/extract/0.log"
Jul 08 05:02:16.680589 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.680501    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bwmp5_1898f762-d419-4ff8-9b91-7c39d5a085d6/manager/0.log"
Jul 08 05:02:16.795545 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:16.795513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dqgwm_4ea1294d-9e65-4cae-bb1d-d3362f1b1d57/manager/0.log"
Jul 08 05:02:17.023736 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:17.023708    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ph7mj_8b408105-5beb-4992-b8fa-ec44048027ed/registry-server/0.log"
Jul 08 05:02:17.376628 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:17.376545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9r44m_1a6138ce-403c-48cb-8fba-f0fd78b8cc6d/manager/0.log"
Jul 08 05:02:18.161054 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:18.161023    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/1.log"
Jul 08 05:02:18.945563 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:18.945527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wzg7q_46ec55ea-85eb-4a6b-8e7c-0fcc0f29b285/main/0.log"
Jul 08 05:02:19.055485 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:19.055457    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dlp6h_9408df12-1066-4d87-aa2a-bcc94a6a9c74/main/0.log"
Jul 08 05:02:19.278291 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:19.278256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tqdrr_3b251318-c8d7-4ca3-8c03-cdefc06b35fa/main/0.log"
Jul 08 05:02:20.524405 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:20.524371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:20.625390 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:20.625356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:23.494137 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494101    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vmbkg/must-gather-4m72m"]
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494442    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494453    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494467    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" containerName="maas-api"
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494472    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" containerName="maas-api"
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494481    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 05:02:23.494516 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494487    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 05:02:23.494709 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494547    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9ac2c2-e43f-4d47-a889-fae417e7e393" containerName="maas-api"
Jul 08 05:02:23.494709 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494554    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e362362-d0ef-4b5c-996c-069197b723a4" containerName="istio-proxy"
Jul 08 05:02:23.494709 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494562    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.494709 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.494568    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.495156 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.495117    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.495156 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.495155    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1c7a43-f28f-46b4-a068-22caa997db3b" containerName="istio-proxy"
Jul 08 05:02:23.501794 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.500796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.504496 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.504466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vmbkg\"/\"default-dockercfg-gwwrx\""
Jul 08 05:02:23.504496 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.504483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vmbkg\"/\"kube-root-ca.crt\""
Jul 08 05:02:23.504694 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.504467    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vmbkg\"/\"openshift-service-ca.crt\""
Jul 08 05:02:23.506321 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.506297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vmbkg/must-gather-4m72m"]
Jul 08 05:02:23.510386 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.510348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:23.578166 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.578118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:23.670272 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.670228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8d50153-a9c8-47b3-9695-2c79f94ec109-must-gather-output\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.670272 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.670274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sf4f\" (UniqueName: \"kubernetes.io/projected/a8d50153-a9c8-47b3-9695-2c79f94ec109-kube-api-access-4sf4f\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.771409 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.771309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8d50153-a9c8-47b3-9695-2c79f94ec109-must-gather-output\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.771409 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.771358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sf4f\" (UniqueName: \"kubernetes.io/projected/a8d50153-a9c8-47b3-9695-2c79f94ec109-kube-api-access-4sf4f\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.771681 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.771661    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8d50153-a9c8-47b3-9695-2c79f94ec109-must-gather-output\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.778922 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.778899    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sf4f\" (UniqueName: \"kubernetes.io/projected/a8d50153-a9c8-47b3-9695-2c79f94ec109-kube-api-access-4sf4f\") pod \"must-gather-4m72m\" (UID: \"a8d50153-a9c8-47b3-9695-2c79f94ec109\") " pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.812616 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.812581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vmbkg/must-gather-4m72m"
Jul 08 05:02:23.945180 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:23.945150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vmbkg/must-gather-4m72m"]
Jul 08 05:02:23.946150 ip-10-0-143-106 kubenswrapper[2562]: W0708 05:02:23.946124    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8d50153_a9c8_47b3_9695_2c79f94ec109.slice/crio-f350177df439fd10c36ac23cf12eda1e93e1df53c6e940ca8f4d2384c2a6e30f WatchSource:0}: Error finding container f350177df439fd10c36ac23cf12eda1e93e1df53c6e940ca8f4d2384c2a6e30f: Status 404 returned error can't find the container with id f350177df439fd10c36ac23cf12eda1e93e1df53c6e940ca8f4d2384c2a6e30f
Jul 08 05:02:24.127116 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:24.127021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vmbkg/must-gather-4m72m" event={"ID":"a8d50153-a9c8-47b3-9695-2c79f94ec109","Type":"ContainerStarted","Data":"f350177df439fd10c36ac23cf12eda1e93e1df53c6e940ca8f4d2384c2a6e30f"}
Jul 08 05:02:25.134716 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:25.134676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vmbkg/must-gather-4m72m" event={"ID":"a8d50153-a9c8-47b3-9695-2c79f94ec109","Type":"ContainerStarted","Data":"2a03b3cd2b40653af68c88f17873e55b34783d75baa186303324fee8eb3c12e0"}
Jul 08 05:02:25.135148 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:25.134737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vmbkg/must-gather-4m72m" event={"ID":"a8d50153-a9c8-47b3-9695-2c79f94ec109","Type":"ContainerStarted","Data":"2781a6b6a6f31ce2fcd9f56c2d6fa29828468f601d9954b6a9acd7bc53041da1"}
Jul 08 05:02:25.152660 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:25.152590    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vmbkg/must-gather-4m72m" podStartSLOduration=1.170167256 podStartE2EDuration="2.152567115s" totalImagesPullingTime="982.399859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 05:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 05:02:25.151013434 +0000 UTC m=+2636.071641919" watchObservedRunningTime="2026-07-08 05:02:25.152567115 +0000 UTC m=+2636.073195593"
Jul 08 05:02:26.531034 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:26.530991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x2dzz_8f3d653f-60c9-4f73-85d3-d4124b1861ea/global-pull-secret-syncer/0.log"
Jul 08 05:02:26.626920 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:26.626885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log"
Jul 08 05:02:26.792729 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:26.792637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-106.ec2.internal_431d5d4114230efc4038e4bf6b8e68b0/haproxy/0.log"
Jul 08 05:02:31.487735 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.487707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/extract/0.log"
Jul 08 05:02:31.518289 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.518255    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/util/0.log"
Jul 08 05:02:31.542305 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.542257    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vwfbr_3e14405d-1646-4b3c-8319-fd3322a9732a/pull/0.log"
Jul 08 05:02:31.572081 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.572046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/extract/0.log"
Jul 08 05:02:31.594468 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.594437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/util/0.log"
Jul 08 05:02:31.614742 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.614710    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rwl2n_2b139a68-79f2-4047-b6c5-846d4c5e24de/pull/0.log"
Jul 08 05:02:31.652096 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.652066    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/extract/0.log"
Jul 08 05:02:31.673421 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.673388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/util/0.log"
Jul 08 05:02:31.697606 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.697574    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49nz_0947b1c3-b7ea-47ae-9203-b1606afce6ed/pull/0.log"
Jul 08 05:02:31.729028 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.728993    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/extract/0.log"
Jul 08 05:02:31.753071 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.752983    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/util/0.log"
Jul 08 05:02:31.775949 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:31.775922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1796jv_b1605648-29e7-4299-9391-cd0f298820a6/pull/0.log"
Jul 08 05:02:32.078557 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:32.078473    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bwmp5_1898f762-d419-4ff8-9b91-7c39d5a085d6/manager/0.log"
Jul 08 05:02:32.108436 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:32.108403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dqgwm_4ea1294d-9e65-4cae-bb1d-d3362f1b1d57/manager/0.log"
Jul 08 05:02:32.178189 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:32.178154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ph7mj_8b408105-5beb-4992-b8fa-ec44048027ed/registry-server/0.log"
Jul 08 05:02:32.431389 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:32.431302    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9r44m_1a6138ce-403c-48cb-8fba-f0fd78b8cc6d/manager/0.log"
Jul 08 05:02:34.086437 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.086407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/alertmanager/0.log"
Jul 08 05:02:34.110316 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.110273    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/config-reloader/0.log"
Jul 08 05:02:34.131846 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.131808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/kube-rbac-proxy-web/0.log"
Jul 08 05:02:34.154197 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.154171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/kube-rbac-proxy/0.log"
Jul 08 05:02:34.176044 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.176010    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/kube-rbac-proxy-metric/0.log"
Jul 08 05:02:34.203996 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.203965    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/prom-label-proxy/0.log"
Jul 08 05:02:34.230396 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.230369    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0afc9c59-b0cc-4a80-9484-c94cc525ae90/init-config-reloader/0.log"
Jul 08 05:02:34.585563 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.585531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrds6_23cd9438-a4a0-4973-9c0b-56054fa0c56b/node-exporter/0.log"
Jul 08 05:02:34.605944 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.605913    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrds6_23cd9438-a4a0-4973-9c0b-56054fa0c56b/kube-rbac-proxy/0.log"
Jul 08 05:02:34.626578 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:34.626549    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nrds6_23cd9438-a4a0-4973-9c0b-56054fa0c56b/init-textfile/0.log"
Jul 08 05:02:35.218413 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:35.218365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:35.319653 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:35.319599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4t99r_8c8fa9f0-c0fd-4b15-8d71-25b5fb091424/konnectivity-agent/0.log" limit=1024
Jul 08 05:02:36.554026 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.553988    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"]
Jul 08 05:02:36.557617 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.557593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.567737 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.567339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"]
Jul 08 05:02:36.617390 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.617353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvlt9\" (UniqueName: \"kubernetes.io/projected/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-kube-api-access-rvlt9\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.617570 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.617423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-lib-modules\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.617570 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.617500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-sys\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.617570 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.617536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-proc\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.617693 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.617671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-podres\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719186 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-podres\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719394 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvlt9\" (UniqueName: \"kubernetes.io/projected/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-kube-api-access-rvlt9\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719394 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-lib-modules\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719394 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-sys\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719394 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-proc\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719621 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-proc\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719621 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-podres\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719945 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-lib-modules\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.719945 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.719918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-sys\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.728222 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.728189    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvlt9\" (UniqueName: \"kubernetes.io/projected/72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92-kube-api-access-rvlt9\") pod \"perf-node-gather-daemonset-tj789\" (UID: \"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92\") " pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:36.872401 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:36.872318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:37.065524 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.065478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"]
Jul 08 05:02:37.070215 ip-10-0-143-106 kubenswrapper[2562]: W0708 05:02:37.070108    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72a0ca9b_79f9_4acf_87b9_bcdfe57bfb92.slice/crio-a9c8d67c40755542c7bc802432ccf96d8b20726f20c2d63afab7a6833d56b970 WatchSource:0}: Error finding container a9c8d67c40755542c7bc802432ccf96d8b20726f20c2d63afab7a6833d56b970: Status 404 returned error can't find the container with id a9c8d67c40755542c7bc802432ccf96d8b20726f20c2d63afab7a6833d56b970
Jul 08 05:02:37.240228 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.240190    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789" event={"ID":"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92","Type":"ContainerStarted","Data":"f93e6035525fffb7c93c02834f2f59214d0b936a1e34fe0be0526251af7534b5"}
Jul 08 05:02:37.240437 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.240257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789" event={"ID":"72a0ca9b-79f9-4acf-87b9-bcdfe57bfb92","Type":"ContainerStarted","Data":"a9c8d67c40755542c7bc802432ccf96d8b20726f20c2d63afab7a6833d56b970"}
Jul 08 05:02:37.240437 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.240290    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:37.256534 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.256470    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789" podStartSLOduration=1.256449255 podStartE2EDuration="1.256449255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 05:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 05:02:37.254580488 +0000 UTC m=+2648.175209008" watchObservedRunningTime="2026-07-08 05:02:37.256449255 +0000 UTC m=+2648.177077730"
Jul 08 05:02:37.608125 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:37.608088    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fd94b4b95-jjhk7_4c1f820d-7303-47ab-809f-386a6a2c5f48/console/0.log"
Jul 08 05:02:39.316138 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:39.316106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vhwrn_ef8ff090-e9d6-410a-80c7-112fd304d280/dns/0.log"
Jul 08 05:02:39.336280 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:39.336251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vhwrn_ef8ff090-e9d6-410a-80c7-112fd304d280/kube-rbac-proxy/0.log"
Jul 08 05:02:39.404317 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:39.404288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zlxf4_8696742d-36e5-4f6e-b22d-f944a329796b/dns-node-resolver/0.log"
Jul 08 05:02:39.995123 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:39.995090    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zhn9k_558744a4-2048-41cb-a017-a9a02e133112/node-ca/0.log"
Jul 08 05:02:41.169302 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:41.169268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/0.log"
Jul 08 05:02:41.226481 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:41.226447    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/1.log"
Jul 08 05:02:42.043482 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:42.043451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zk9vj_4166f690-b9aa-4e88-a5c7-c70490e73d66/serve-healthcheck-canary/0.log"
Jul 08 05:02:42.658030 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:42.657997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkc8x_e1da6069-aeae-4676-ad9e-5a3706d39b82/kube-rbac-proxy/0.log"
Jul 08 05:02:42.677951 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:42.677917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkc8x_e1da6069-aeae-4676-ad9e-5a3706d39b82/exporter/0.log"
Jul 08 05:02:42.698733 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:42.698702    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkc8x_e1da6069-aeae-4676-ad9e-5a3706d39b82/extractor/0.log"
Jul 08 05:02:43.259946 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:43.259921    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vmbkg/perf-node-gather-daemonset-tj789"
Jul 08 05:02:44.991206 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:44.991125    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h2c8g_a9cfd22d-e7e0-42f6-b954-0db8c87bb2de/manager/0.log"
Jul 08 05:02:45.161665 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:45.161449    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55c7f6b5f9-nhq5s_34b207c4-5b64-4cdd-bc7d-ae682ee36797/manager/0.log"
Jul 08 05:02:45.326971 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:45.326932    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f76f945bd-5wx2r_d158b6ec-9010-493d-8493-f083e5ccdb01/manager/0.log"
Jul 08 05:02:45.354906 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:45.354851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f76f945bd-5wx2r_d158b6ec-9010-493d-8493-f083e5ccdb01/copy-manifests/0.log"
Jul 08 05:02:46.922774 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:46.922693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75c8b6477f-9sthc_4576e945-504a-4afd-b93e-38f93bc4235a/manager/0.log"
Jul 08 05:02:47.451065 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:47.451031    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/0.log"
Jul 08 05:02:47.498002 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:47.497969    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/1.log"
Jul 08 05:02:48.948509 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:48.948464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/0.log"
Jul 08 05:02:49.010871 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:49.010804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zbxzq_cb08810a-6d91-4faf-bc23-706012943271/istio-proxy/1.log"
Jul 08 05:02:53.440260 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.440231    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/kube-multus-additional-cni-plugins/0.log"
Jul 08 05:02:53.459337 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.459304    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/egress-router-binary-copy/0.log"
Jul 08 05:02:53.478810 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.478784    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/cni-plugins/0.log"
Jul 08 05:02:53.496772 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.496736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/bond-cni-plugin/0.log"
Jul 08 05:02:53.514907 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.514848    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/routeoverride-cni/0.log"
Jul 08 05:02:53.533456 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.533430    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/whereabouts-cni-bincopy/0.log"
Jul 08 05:02:53.553320 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.553286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bsd5k_4939047a-a472-4db4-bef0-7d3a0a114182/whereabouts-cni/0.log"
Jul 08 05:02:53.791733 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.791698    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-trncw_64455557-0e0d-4f7a-8a7f-de5351a3f2b4/kube-multus/0.log"
Jul 08 05:02:53.866484 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.866452    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6sw9w_323ceb42-e486-41f7-b456-ec33939b321f/network-metrics-daemon/0.log"
Jul 08 05:02:53.884999 ip-10-0-143-106 kubenswrapper[2562]: I0708 05:02:53.884974    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6sw9w_323ceb42-e486-41f7-b456-ec33939b321f/kube-rbac-proxy/0.log"