Jul 21 19:35:06.948947 ip-10-0-134-115 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 19:35:06.948964 ip-10-0-134-115 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 19:35:06.948974 ip-10-0-134-115 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 19:35:06.949318 ip-10-0-134-115 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 19:35:18.115208 ip-10-0-134-115 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 19:35:18.115228 ip-10-0-134-115 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 68f216e9d1fb4d7391fa165be2a21450 --
Jul 21 19:37:11.155308 ip-10-0-134-115 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.595115    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600401    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600414    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600417    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600421    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600425    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600428    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600432    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.669373 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600434    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600437    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600439    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600442    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600445    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600447    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600456    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600481    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600485    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600488    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600491    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600494    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600496    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600499    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600501    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600504    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600507    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600511    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600516    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600519    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.670554 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600522    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600525    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600528    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600530    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600533    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600535    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600538    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600540    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600543    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600546    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600548    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600552    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600556    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600559    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600562    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600565    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600567    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600571    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600574    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.671369 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600576    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600579    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600581    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600584    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600587    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600589    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600592    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600595    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600598    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600600    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600603    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600605    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600608    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600610    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600612    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600615    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600617    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600620    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600622    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600626    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.672186 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600629    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600631    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600634    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600637    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600640    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600642    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600646    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600648    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600652    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600654    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600657    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600660    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600663    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600666    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600668    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600671    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600673    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600675    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600678    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600682    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.672968 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600685    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600688    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600690    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600693    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600695    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600698    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600701    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600704    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600706    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600709    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600713    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600716    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.600719    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602306    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602318    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602322    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602325    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602328    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602330    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602334    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.673749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602337    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602340    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602345    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602348    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602351    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602354    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602357    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602359    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602361    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602364    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602367    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602369    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602372    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602375    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602377    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602380    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602383    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602385    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602388    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602390    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.674555 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602393    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602397    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602399    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602402    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602405    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602407    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602410    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602412    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602415    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602418    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602420    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602423    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602426    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602429    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602431    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602434    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602437    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602439    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602441    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602444    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.675340 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602446    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602449    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602451    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602455    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602458    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602460    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602464    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602466    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602469    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602471    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602475    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602479    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602482    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602485    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602488    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602491    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602494    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602496    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602499    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.676161 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602503    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602507    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602510    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602513    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602517    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602520    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602522    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602525    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602528    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602531    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602534    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602536    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602539    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602541    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602544    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602547    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602550    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602553    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602556    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602559    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.676946 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602562    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602564    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602567    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602570    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602573    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602575    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602578    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602581    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602583    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602587    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602589    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602592    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602594    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602954    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602959    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602963    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602966    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602969    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602992    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.677752 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602995    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.602998    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603001    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603004    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603006    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603009    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603012    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603014    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603017    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603019    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603023    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603026    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603029    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603032    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603036    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603039    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603043    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603046    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603049    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603052    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.678559 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603054    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603058    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603060    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603063    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603066    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603069    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603072    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603075    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603078    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603081    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603083    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603087    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603090    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603093    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603095    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603097    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603100    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603103    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603105    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.679353 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603108    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603111    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603113    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603116    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603120    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603122    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603124    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603127    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603129    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603132    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603135    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603137    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603139    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603142    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603145    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603147    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603152    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603154    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603157    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603159    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.680152 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603162    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603165    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603167    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603170    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603174    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603176    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603179    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603181    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603184    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603187    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603190    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603192    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603195    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603197    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603200    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603202    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603205    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603208    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603210    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603213    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.680944 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603215    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603218    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603222    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603225    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603228    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603231    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603233    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603236    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603240    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603243    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603246    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603248    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603251    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603254    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603329    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603336    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603343    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603347    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603351    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603355    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603359    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 19:37:11.681749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603363    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603366    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603369    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603372    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603376    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603379    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603382    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603385    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603388    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603392    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603396    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603403    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603406    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603409    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603412    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603416    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603419    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603422    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603425    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603430    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603433    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603436    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603439    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603442    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 19:37:11.682582 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603445    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603449    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603452    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603456    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603459    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603462    2573 flags.go:64] FLAG: --enable-server="true"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603465    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603469    2573 flags.go:64] FLAG: --event-burst="100"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603472    2573 flags.go:64] FLAG: --event-qps="50"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603475    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603478    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603481    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603485    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603487    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603491    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603494    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603497    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603500    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603503    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603506    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603509    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603512    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603515    2573 flags.go:64] FLAG: --feature-gates=""
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603519    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603522    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 19:37:11.683382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603525    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603528    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603532    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603535    2573 flags.go:64] FLAG: --help="false"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603538    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603541    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603544    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603548    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603551    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603554    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603559    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603562    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603565    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603568    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603571    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603574    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603577    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603579    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603582    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603585    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603588    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603591    2573 flags.go:64] FLAG: --lock-file=""
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603594    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603596    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 19:37:11.684188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603599    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603605    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603608    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603611    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603613    2573 flags.go:64] FLAG: --logging-format="text"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603617    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603620    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603622    2573 flags.go:64] FLAG: --manifest-url=""
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603625    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603629    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603634    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603638    2573 flags.go:64] FLAG: --max-pods="110"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603641    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603643    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603646    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603649    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603652    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603655    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603659    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603667    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603670    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603673    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603676    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 21 19:37:11.689803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603679    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603684    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603687    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603690    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603693    2573 flags.go:64] FLAG: --port="10250"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603696    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603699    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0328173290184152a"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603702    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603705    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603708    2573 flags.go:64] FLAG: --register-node="true"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603711    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603714    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603718    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603721    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603724    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603728    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603730    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603733    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603736    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603740    2573 flags.go:64] FLAG: --runonce="false"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603743    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603746    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603749    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603752    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603755    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603758    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 19:37:11.690659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603761    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603764    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603768    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603771    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603774    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603777    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603780    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603783    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603785    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603791    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603794    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603796    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603801    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603804    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603807    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603810    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603812    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603815    2573 flags.go:64] FLAG: --v="2"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603819    2573 flags.go:64] FLAG: --version="false"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603823    2573 flags.go:64] FLAG: --vmodule=""
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603827    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.603830    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603947    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603951    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.798878 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603954    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603959    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603962    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603965    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603968    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603971    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603988    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603992    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603996    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.603999    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604003    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604006    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604009    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604012    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604014    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604017    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604020    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604023    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604025    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.799665 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604028    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604031    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604033    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604036    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604038    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604041    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604044    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604047    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604049    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604053    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604055    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604058    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604060    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604063    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604066    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604069    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604072    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604074    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604077    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.800471 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604079    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604082    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604085    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604087    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604091    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604094    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604096    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604099    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604101    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604104    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604108    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604111    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604114    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604117    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604120    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604123    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604125    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604127    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604130    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604143    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.801256 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604147    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604150    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604152    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604156    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604159    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604161    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604165    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604170    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604173    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604176    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604179    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604181    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604185    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604188    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604191    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604194    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604198    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604201    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604204    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.802062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604206    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604210    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604213    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604216    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604219    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604221    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604224    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604227    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604229    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604232    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604234    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604237    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604239    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604242    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604244    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604247    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604249    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604253    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604255    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.802853 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.604258    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.605025    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.612179    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.612196    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.613031    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.613042    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613108    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613113    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613117    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613120    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613123    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613126    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613130    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613135    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.803646 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613138    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613141    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613144    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613147    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613150    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613153    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613156    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613159    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613161    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613164    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613166    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613169    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613172    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613174    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613177    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613184    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613186    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613189    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613191    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.804435 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613194    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613197    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613200    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613203    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613206    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613208    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613211    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613214    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613216    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613219    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613221    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613224    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613226    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613229    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613232    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613234    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613239    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613241    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613244    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.805255 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613246    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613250    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613254    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613257    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613259    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613261    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613264    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613267    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613269    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613273    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613275    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613278    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613280    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613283    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613285    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613288    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613291    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613293    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613296    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.806440 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613298    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613301    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613304    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613306    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613309    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613311    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613314    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613316    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613319    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613321    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613325    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613328    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613331    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613333    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613336    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613338    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613341    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613343    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613346    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613348    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.807626 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613352    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613356    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613360    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613363    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613366    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613369    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613372    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613375    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613377    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613380    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613383    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613385    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613388    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613390    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.613395    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 19:37:11.808437 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613533    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613538    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613541    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613544    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613547    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613550    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613553    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613556    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613560    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613562    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613565    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613567    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613570    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613573    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613575    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613578    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613581    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613583    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613586    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613589    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 19:37:11.809244 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613592    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613594    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613597    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613599    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613602    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613604    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613607    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613611    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613615    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613617    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613620    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613623    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613626    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613629    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613631    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613634    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613636    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613639    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613642    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613644    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 19:37:11.810062 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613648    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613651    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613653    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613656    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613658    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613661    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613663    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613665    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613668    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613671    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613673    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613677    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613679    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613682    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613684    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613687    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613689    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613692    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613694    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613697    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 19:37:11.810848 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613699    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613702    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613705    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613707    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613710    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613712    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613714    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613717    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613719    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613722    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613724    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613727    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613732    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613736    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613739    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613742    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613745    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613748    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613751    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 19:37:11.811642 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613753    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613756    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613758    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613761    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613764    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613768    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613771    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613774    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613776    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613779    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613781    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613784    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613786    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613789    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613791    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613794    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613797    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613799    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613802    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 19:37:11.812438 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:11.613804    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.613809    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.613916    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.616109    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.617319    2573 server.go:1019] "Starting client certificate rotation"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.617418    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.617485    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.619815    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.621581    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.631928    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.635290    2573 log.go:25] "Validated CRI v1 image API"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.636061    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 19:37:11.813250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.638285    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b60590b2-0872-4df7-a97c-a7ea684af832:/dev/nvme0n1p3 f0b94099-19c1-46d1-9ce3-cd61d00a0e0f:/dev/nvme0n1p4]
Jul 21 19:37:11.813648 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.638299    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.643282    2573 manager.go:216] Machine: {Timestamp:2026-07-21 19:37:11.642784301 +0000 UTC m=+0.362307982 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3150396 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29f21ef8b5b3a748d4629bd514521d SystemUUID:ec29f21e-f8b5-b3a7-48d4-629bd514521d BootID:68f216e9-d1fb-4d73-91fa-165be2a21450 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:61:fe:50:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:61:fe:50:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:d8:7b:b4:70:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.643374    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.643447    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.647786    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.647828    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.648523    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.648537    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 19:37:11.814056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.648547    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.648562    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.649798    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.652616    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.652755    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653471    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653486    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653502    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653515    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653527    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653938    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:11.653959    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:11.665650    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 19:37:11.818157 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:11.665701    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 19:37:13.960692 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:13.932296    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.073135    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.075831    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.075883    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077410    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077433    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077442    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077450    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077463    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077471    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077483    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077491    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077501    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077509    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077522    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.077531    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.078155    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 19:37:14.081938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.078166    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.082186    2573 server.go:1268] "Started kubelet"
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.082285    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.082300    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.082373    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.084360    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 19:37:14.086186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.085131    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 19:37:14.083086 ip-10-0-134-115 systemd[1]: Started Kubernetes Kubelet.
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.088116    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.088586    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.088033    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-115.ec2.internal.18c46535cc612ed2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-115.ec2.internal,UID:ip-10-0-134-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-115.ec2.internal,},FirstTimestamp:2026-07-21 19:37:14.082152146 +0000 UTC m=+1.794936712,LastTimestamp:2026-07-21 19:37:14.082152146 +0000 UTC m=+1.794936712,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-115.ec2.internal,}"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.091594    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.091607    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.091673    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.092521    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.092536    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.092523    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.092642    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.092649    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093079    2573 factory.go:55] Registering systemd factory
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093092    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093311    2573 factory.go:153] Registering CRI-O factory
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093323    2573 factory.go:223] Registration of the crio container factory successfully
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093369    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093387    2573 factory.go:103] Registering Raw factory
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093397    2573 manager.go:1196] Started watching for new ooms in manager
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.093756    2573 manager.go:349] Starting recovery of all containers
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.099407    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.100835    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.100830    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.105098    2573 manager.go:354] Recovery completed
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.110428    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114155    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114190    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114204    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114811    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114825    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114837    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.114843    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 19:37:14.193855 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.115488    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.115515    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.115528    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.115974    2573 policy_none.go:49] "None policy: Start"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.116003    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.116023    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.116935    2573 policy_none.go:47] "Start"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.123613    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.123646    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-115.ec2.internal.18c46535ce49c4b7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-115.ec2.internal,UID:ip-10-0-134-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-115.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-115.ec2.internal,},FirstTimestamp:2026-07-21 19:37:14.114172087 +0000 UTC m=+1.826956652,LastTimestamp:2026-07-21 19:37:14.114172087 +0000 UTC m=+1.826956652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-115.ec2.internal,}"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.126238    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-115.ec2.internal.18c46535ce4a2292  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-115.ec2.internal,UID:ip-10-0-134-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-115.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-115.ec2.internal,},FirstTimestamp:2026-07-21 19:37:14.114196114 +0000 UTC m=+1.826980680,LastTimestamp:2026-07-21 19:37:14.114196114 +0000 UTC m=+1.826980680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-115.ec2.internal,}"
Jul 21 19:37:14.195358 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.192596    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.293533 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.293512    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.294531 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.294454    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-115.ec2.internal.18c46535ce4a5942  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-115.ec2.internal,UID:ip-10-0-134-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-115.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-115.ec2.internal,},FirstTimestamp:2026-07-21 19:37:14.114210114 +0000 UTC m=+1.826994685,LastTimestamp:2026-07-21 19:37:14.114210114 +0000 UTC m=+1.826994685,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-115.ec2.internal,}"
Jul 21 19:37:14.297004 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.296980    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 19:37:14.297092 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.297052    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zgjx9"
Jul 21 19:37:14.297512 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.297421    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-115.ec2.internal.18c46535ce49c4b7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-115.ec2.internal.18c46535ce49c4b7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-115.ec2.internal,UID:ip-10-0-134-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-115.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-115.ec2.internal,},FirstTimestamp:2026-07-21 19:37:14.114172087 +0000 UTC m=+1.826956652,LastTimestamp:2026-07-21 19:37:14.115499068 +0000 UTC m=+1.828283633,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-115.ec2.internal,}"
Jul 21 19:37:14.310697 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.310679    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-115.ec2.internal\" not found" node="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.329035 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.328861    2573 manager.go:337] "Starting Device Plugin manager"
Jul 21 19:37:14.329146 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.329064    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 19:37:14.329146 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329075    2573 server.go:87] "Starting device plugin registration server"
Jul 21 19:37:14.329283 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329273    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 19:37:14.329316 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329284    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 19:37:14.329398 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329384    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 19:37:14.329479 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329467    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 19:37:14.329521 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.329481    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 19:37:14.330056 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.330023    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 19:37:14.330130 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.330093    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.408917 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.408888    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 19:37:14.409841 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.408929    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 19:37:14.409841 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.408949    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 19:37:14.409841 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.408978    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 19:37:14.411670 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.411646    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 19:37:14.429901 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.429886    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.430778 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.430763    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.430846 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.430790    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.430846 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.430808    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.430846 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.430829    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.440661 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.440644    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.440779 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.440668    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-115.ec2.internal\": node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.466895 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.466867    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.509289 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.509249    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"]
Jul 21 19:37:14.509391 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.509347    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.511430 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.511416    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.511527 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.511448    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.511527 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.511462    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.512791 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.512776    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.512949 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.512936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.512994 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.512963    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.513559 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513543    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.513627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513546    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.513627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513572    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.513627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513602    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.513627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513601    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.513627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.513626    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.514762 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.514747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.514844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.514781    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:14.515473 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.515456    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:14.515532 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.515487    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:14.515532 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.515501    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:14.542342 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.542324    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-115.ec2.internal\" not found" node="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.547005 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.546991    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-115.ec2.internal\" not found" node="ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.567005 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.566987    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.595876 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.595854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.595972 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.595886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.595972 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.595907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a29197a2a94d2c43d1d11c59bf640ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-115.ec2.internal\" (UID: \"8a29197a2a94d2c43d1d11c59bf640ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.623189 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.623166    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 19:37:14.623318 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.623300    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 19:37:14.667763 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.667686    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.696026 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.696107 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.696107 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a29197a2a94d2c43d1d11c59bf640ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-115.ec2.internal\" (UID: \"8a29197a2a94d2c43d1d11c59bf640ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.696107 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.696200 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696138    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a17f8153952c59d972a5936a9e5cf68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" (UID: \"8a17f8153952c59d972a5936a9e5cf68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.696200 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.696182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a29197a2a94d2c43d1d11c59bf640ff-config\") pod \"kube-apiserver-proxy-ip-10-0-134-115.ec2.internal\" (UID: \"8a29197a2a94d2c43d1d11c59bf640ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.768177 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.768128    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.845770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.845736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.850168 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:14.849569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:14.868595 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.868569    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:14.969171 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:14.969067    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.069667 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.069630    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.143163 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.143130    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 19:37:15.170490 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.170449    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.271077 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.270993    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.291174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.291147    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 19:37:15.292519 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.292502    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 19:37:15.292592 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.292536    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 19:37:15.292592 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.292552    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeHasSufficientPID"
Jul 21 19:37:15.303241 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.303213    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 19:32:12 +0000 UTC" deadline="2028-04-30 00:52:11.603165044 +0000 UTC"
Jul 21 19:37:15.303241 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.303235    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15557h14m56.299933019s"
Jul 21 19:37:15.371469 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.371435    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.420095 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:15.420066    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a17f8153952c59d972a5936a9e5cf68.slice/crio-3fe82236cfeaf75d438447a64560b6730ff6ef5d866e0174f2b929235e138e7e WatchSource:0}: Error finding container 3fe82236cfeaf75d438447a64560b6730ff6ef5d866e0174f2b929235e138e7e: Status 404 returned error can't find the container with id 3fe82236cfeaf75d438447a64560b6730ff6ef5d866e0174f2b929235e138e7e
Jul 21 19:37:15.424116 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.424102    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 19:37:15.472290 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.472255    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.475262 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:15.475236    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a29197a2a94d2c43d1d11c59bf640ff.slice/crio-b050df96735fc966ab16b0490af3d80b5d6c24107cc8b7511d8af37a6df4e642 WatchSource:0}: Error finding container b050df96735fc966ab16b0490af3d80b5d6c24107cc8b7511d8af37a6df4e642: Status 404 returned error can't find the container with id b050df96735fc966ab16b0490af3d80b5d6c24107cc8b7511d8af37a6df4e642
Jul 21 19:37:15.573020 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.572942    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.641893 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:15.641857    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 19:37:15.673169 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.673145    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.773663 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.773631    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.874221 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.874146    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:15.974753 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:15.974708    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.075262 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.075223    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.176379 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.176297    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.277036 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.277000    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.377915 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.377878    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.414419 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:16.414310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal" event={"ID":"8a29197a2a94d2c43d1d11c59bf640ff","Type":"ContainerStarted","Data":"b050df96735fc966ab16b0490af3d80b5d6c24107cc8b7511d8af37a6df4e642"}
Jul 21 19:37:16.415602 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:16.415543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal" event={"ID":"8a17f8153952c59d972a5936a9e5cf68","Type":"ContainerStarted","Data":"3fe82236cfeaf75d438447a64560b6730ff6ef5d866e0174f2b929235e138e7e"}
Jul 21 19:37:16.478679 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.478565    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.484205 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:16.483855    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 19:37:16.579396 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.579363    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.680269 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.680236    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.780853 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.780776    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.881348 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.881317    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:16.981864 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:16.981834    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-115.ec2.internal\" not found"
Jul 21 19:37:17.003051 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.003026    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 19:37:17.092704 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.092664    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:17.093792 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.093769    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 19:37:17.104627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.104607    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 19:37:17.105614 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.105598    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:17.106822 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.106802    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 19:37:17.114165 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.114147    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 19:37:17.127141 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.127113    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7729"
Jul 21 19:37:17.133280 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.133256    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7729"
Jul 21 19:37:17.419001 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.418950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal" event={"ID":"8a29197a2a94d2c43d1d11c59bf640ff","Type":"ContainerStarted","Data":"d02d662a4d8854ee6f6a0e31b5c74ee038f30e5b0ed0ca7852fc29d52384dbb2"}
Jul 21 19:37:17.419182 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.419166    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:17.428271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.428249    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 19:37:17.428394 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.428302    2573 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-115.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:17.664070 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.663989    2573 apiserver.go:52] "Watching apiserver"
Jul 21 19:37:17.672763 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.672736    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 19:37:17.673094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.673074    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nvc5w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal","openshift-multus/multus-additional-cni-plugins-49mdm","openshift-network-operator/iptables-alerter-wnl9k","kube-system/konnectivity-agent-24ln4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx","openshift-multus/multus-pw9bq","openshift-multus/network-metrics-daemon-rhb84","openshift-network-diagnostics/network-check-target-27rts","openshift-ovn-kubernetes/ovnkube-node-5qc2b","kube-system/global-pull-secret-syncer-rm4nq","kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cpccv","openshift-dns/node-resolver-slgpm"]
Jul 21 19:37:17.674402 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.674383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.675420 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.675397    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.676453 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.676436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.677166 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677149    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 19:37:17.677463 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.677669 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677634    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.677859 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677845    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.677948 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677882    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 19:37:17.677948 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677897    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.678044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.677961    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r8xrp\""
Jul 21 19:37:17.678544 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.678527    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.678630 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.678563    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.678709 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.678686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9kwnh\""
Jul 21 19:37:17.679351 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.679318    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 19:37:17.679444 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.679356    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 19:37:17.679444 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.679409    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hmtr\""
Jul 21 19:37:17.679731 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.679700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.680218 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.680192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6jrdp\""
Jul 21 19:37:17.680758 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.680689    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 19:37:17.680758 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.680689    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.680922 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.680866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:17.682607 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.681316    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:17.682607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.680732    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.682607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.681878    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 19:37:17.682607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.682037    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f46tk\""
Jul 21 19:37:17.682992 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.682681    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 19:37:17.683594 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.683190    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.683852 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.683832    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.684100 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.684081    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 19:37:17.684192 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.684143    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.684704 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.684683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.684815 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.684740    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bv6wr\""
Jul 21 19:37:17.686177 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.686156    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.686177 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.686177    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jcm2\""
Jul 21 19:37:17.686469 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.686456    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 19:37:17.687101 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.687088    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.687359 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.687288    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.687585 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.687568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68cj6\""
Jul 21 19:37:17.687943 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.687926    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.687943 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.687941    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.688271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.688258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.688335 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.688319    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:17.689455 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.689441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.689511 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.689496    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:17.690048 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.690034    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 19:37:17.690320 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.690305    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 19:37:17.690362 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.690337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qdwq8\""
Jul 21 19:37:17.691845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.691824    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 19:37:17.691940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.691858    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 19:37:17.691940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.691889    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 19:37:17.691940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.691904    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 19:37:17.693349 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.693336    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 19:37:17.712350 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712330    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-config\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712430 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.712430 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-cnibin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.712502 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-netns\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.712502 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/804971ce-9fbd-4f02-a2f0-d670bfda1379-konnectivity-ca\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.712502 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-cnibin\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.712604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.712604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-log-socket\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-multus\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-conf-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-lib-modules\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-system-cni-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jdr\" (UniqueName: \"kubernetes.io/projected/080cbdb8-3732-4133-839b-390418c44c68-kube-api-access-d2jdr\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngrb\" (UniqueName: \"kubernetes.io/projected/8e3ee25e-530d-42c4-b9b1-67664ee2001e-kube-api-access-sngrb\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-systemd-units\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d39a08a2-7f02-4332-adec-e44912128da2-ovn-node-metrics-cert\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-kubelet\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-var-lib-kubelet\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrzc\" (UniqueName: \"kubernetes.io/projected/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-kube-api-access-jzrzc\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/080cbdb8-3732-4133-839b-390418c44c68-host-slash\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-env-overrides\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-modprobe-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.712990 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.712980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-device-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-slash\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-bin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhd8s\" (UniqueName: \"kubernetes.io/projected/e9bdf129-56e9-427e-b80d-5f1d748f7720-kube-api-access-xhd8s\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-tmp\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46n8h\" (UniqueName: \"kubernetes.io/projected/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-kube-api-access-46n8h\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.713239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdtk\" (UniqueName: \"kubernetes.io/projected/b64fc516-c7de-4c78-bbb2-3085168c83ae-kube-api-access-kcdtk\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4030f7e4-0205-4571-8678-f00d0a7c50fb-tmp-dir\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-var-lib-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtfk\" (UniqueName: \"kubernetes.io/projected/d39a08a2-7f02-4332-adec-e44912128da2-kube-api-access-hbtfk\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-os-release\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713362    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-node-log\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-k8s-cni-cncf-io\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-multus-certs\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-kubernetes\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-run\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-sys\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-tuned\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.713573 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4030f7e4-0205-4571-8678-f00d0a7c50fb-hosts-file\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-kubelet\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-dbus\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-socket-dir-parent\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/080cbdb8-3732-4133-839b-390418c44c68-iptables-alerter-script\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-script-lib\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-kubelet-config\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-systemd\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/804971ce-9fbd-4f02-a2f0-d670bfda1379-agent-certs\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.714174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e3ee25e-530d-42c4-b9b1-67664ee2001e-serviceca\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-netd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-etc-kubernetes\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-host\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-etc-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.713999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-bin\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714029    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-cni-binary-copy\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-hostroot\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysconfig\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlxk\" (UniqueName: \"kubernetes.io/projected/56cfd511-184e-41bd-b6ad-d81625679e3a-kube-api-access-8dlxk\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-system-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.714641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-conf\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3ee25e-530d-42c4-b9b1-67664ee2001e-host\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-systemd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-netns\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-daemon-config\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714318    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-os-release\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpls\" (UniqueName: \"kubernetes.io/projected/4030f7e4-0205-4571-8678-f00d0a7c50fb-kube-api-access-htpls\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.715158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.714345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-ovn\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.815083 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4030f7e4-0205-4571-8678-f00d0a7c50fb-hosts-file\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.815083 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-kubelet\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815100    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-dbus\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-socket-dir-parent\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-kubelet\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4030f7e4-0205-4571-8678-f00d0a7c50fb-hosts-file\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/080cbdb8-3732-4133-839b-390418c44c68-iptables-alerter-script\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-script-lib\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-kubelet-config\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.815273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-systemd\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/804971ce-9fbd-4f02-a2f0-d670bfda1379-agent-certs\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.815318    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-socket-dir-parent\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e3ee25e-530d-42c4-b9b1-67664ee2001e-serviceca\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815357    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-kubelet-config\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90c50097-f13b-49ee-b90b-73c984d779e6-dbus\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-systemd\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.815409    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:18.31536479 +0000 UTC m=+6.028149358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-netd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-etc-kubernetes\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-host\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.815770 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-etc-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-bin\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-cni-binary-copy\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-hostroot\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-netd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.815690    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815744    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysconfig\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815750    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-etc-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.815764    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:18.315747997 +0000 UTC m=+6.028532565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysconfig\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815789    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-host\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815813    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlxk\" (UniqueName: \"kubernetes.io/projected/56cfd511-184e-41bd-b6ad-d81625679e3a-kube-api-access-8dlxk\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.816441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-hostroot\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/080cbdb8-3732-4133-839b-390418c44c68-iptables-alerter-script\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-cni-bin\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-system-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-etc-kubernetes\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-conf\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3ee25e-530d-42c4-b9b1-67664ee2001e-host\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-system-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-systemd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.815993    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-script-lib\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816014    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e3ee25e-530d-42c4-b9b1-67664ee2001e-host\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-netns\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-systemd\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-conf\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.817045 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-daemon-config\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-run-netns\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-os-release\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htpls\" (UniqueName: \"kubernetes.io/projected/4030f7e4-0205-4571-8678-f00d0a7c50fb-kube-api-access-htpls\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-ovn\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-config\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-os-release\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816262    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-run-ovn\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816320    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-cnibin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816343    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-cni-binary-copy\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.817610 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-cnibin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-netns\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816424    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e3ee25e-530d-42c4-b9b1-67664ee2001e-serviceca\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816417    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/804971ce-9fbd-4f02-a2f0-d670bfda1379-konnectivity-ca\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-cnibin\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-netns\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-daemon-config\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-log-socket\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-cnibin\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-multus\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-conf-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-lib-modules\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816626    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816626    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-log-socket\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-multus\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-system-cni-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-conf-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jdr\" (UniqueName: \"kubernetes.io/projected/080cbdb8-3732-4133-839b-390418c44c68-kube-api-access-d2jdr\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b64fc516-c7de-4c78-bbb2-3085168c83ae-system-cni-dir\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-ovnkube-config\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816760    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-lib-modules\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngrb\" (UniqueName: \"kubernetes.io/projected/8e3ee25e-530d-42c4-b9b1-67664ee2001e-kube-api-access-sngrb\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-systemd-units\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.818683 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d39a08a2-7f02-4332-adec-e44912128da2-ovn-node-metrics-cert\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-kubelet\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-systemd-units\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-var-lib-kubelet\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-kubelet\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-var-lib-kubelet\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-sysctl-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrzc\" (UniqueName: \"kubernetes.io/projected/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-kube-api-access-jzrzc\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.816975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/080cbdb8-3732-4133-839b-390418c44c68-host-slash\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-env-overrides\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817024    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-modprobe-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/080cbdb8-3732-4133-839b-390418c44c68-host-slash\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.819160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-device-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-slash\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817141    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-modprobe-d\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-bin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhd8s\" (UniqueName: \"kubernetes.io/projected/e9bdf129-56e9-427e-b80d-5f1d748f7720-kube-api-access-xhd8s\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-device-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-host-slash\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-var-lib-cni-bin\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-tmp\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46n8h\" (UniqueName: \"kubernetes.io/projected/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-kube-api-access-46n8h\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d39a08a2-7f02-4332-adec-e44912128da2-env-overrides\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.819534 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdtk\" (UniqueName: \"kubernetes.io/projected/b64fc516-c7de-4c78-bbb2-3085168c83ae-kube-api-access-kcdtk\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4030f7e4-0205-4571-8678-f00d0a7c50fb-tmp-dir\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-var-lib-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817591    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-var-lib-openvswitch\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtfk\" (UniqueName: \"kubernetes.io/projected/d39a08a2-7f02-4332-adec-e44912128da2-kube-api-access-hbtfk\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-os-release\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-node-log\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-multus-cni-dir\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-k8s-cni-cncf-io\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817847    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4030f7e4-0205-4571-8678-f00d0a7c50fb-tmp-dir\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d39a08a2-7f02-4332-adec-e44912128da2-node-log\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-k8s-cni-cncf-io\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-multus-certs\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817901    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-os-release\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9bdf129-56e9-427e-b80d-5f1d748f7720-host-run-multus-certs\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-kubernetes\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.817996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-kubernetes\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-run\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-sys\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-tuned\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/804971ce-9fbd-4f02-a2f0-d670bfda1379-konnectivity-ca\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818098    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-run\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-sys\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56cfd511-184e-41bd-b6ad-d81625679e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.818987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.820467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.819189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b64fc516-c7de-4c78-bbb2-3085168c83ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.820868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.819902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-tmp\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.820066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d39a08a2-7f02-4332-adec-e44912128da2-ovn-node-metrics-cert\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.820868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.820098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-etc-tuned\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.820868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.820186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/804971ce-9fbd-4f02-a2f0-d670bfda1379-agent-certs\") pod \"konnectivity-agent-24ln4\" (UID: \"804971ce-9fbd-4f02-a2f0-d670bfda1379\") " pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:17.825226 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.825209    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:17.825305 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.825231    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:17.825305 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.825240    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:17.825305 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:17.825286    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:18.325272134 +0000 UTC m=+6.038056704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:17.829339 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.829312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrzc\" (UniqueName: \"kubernetes.io/projected/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-kube-api-access-jzrzc\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:17.829704 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.829685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtfk\" (UniqueName: \"kubernetes.io/projected/d39a08a2-7f02-4332-adec-e44912128da2-kube-api-access-hbtfk\") pod \"ovnkube-node-5qc2b\" (UID: \"d39a08a2-7f02-4332-adec-e44912128da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:17.830277 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.830254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhd8s\" (UniqueName: \"kubernetes.io/projected/e9bdf129-56e9-427e-b80d-5f1d748f7720-kube-api-access-xhd8s\") pod \"multus-pw9bq\" (UID: \"e9bdf129-56e9-427e-b80d-5f1d748f7720\") " pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.831025 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.831007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdtk\" (UniqueName: \"kubernetes.io/projected/b64fc516-c7de-4c78-bbb2-3085168c83ae-kube-api-access-kcdtk\") pod \"multus-additional-cni-plugins-49mdm\" (UID: \"b64fc516-c7de-4c78-bbb2-3085168c83ae\") " pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:17.831112 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.831045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlxk\" (UniqueName: \"kubernetes.io/projected/56cfd511-184e-41bd-b6ad-d81625679e3a-kube-api-access-8dlxk\") pod \"aws-ebs-csi-driver-node-hc2bx\" (UID: \"56cfd511-184e-41bd-b6ad-d81625679e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:17.831402 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.831385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46n8h\" (UniqueName: \"kubernetes.io/projected/c4851fe4-662d-4f35-b4ac-6d916ae04fa3-kube-api-access-46n8h\") pod \"tuned-cpccv\" (UID: \"c4851fe4-662d-4f35-b4ac-6d916ae04fa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.831630 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.831612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jdr\" (UniqueName: \"kubernetes.io/projected/080cbdb8-3732-4133-839b-390418c44c68-kube-api-access-d2jdr\") pod \"iptables-alerter-wnl9k\" (UID: \"080cbdb8-3732-4133-839b-390418c44c68\") " pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:17.833850 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.833827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpls\" (UniqueName: \"kubernetes.io/projected/4030f7e4-0205-4571-8678-f00d0a7c50fb-kube-api-access-htpls\") pod \"node-resolver-slgpm\" (UID: \"4030f7e4-0205-4571-8678-f00d0a7c50fb\") " pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:17.833966 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.833950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngrb\" (UniqueName: \"kubernetes.io/projected/8e3ee25e-530d-42c4-b9b1-67664ee2001e-kube-api-access-sngrb\") pod \"node-ca-nvc5w\" (UID: \"8e3ee25e-530d-42c4-b9b1-67664ee2001e\") " pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:17.839040 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.839006    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal" podStartSLOduration=0.838994816 podStartE2EDuration="838.994816ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:17.838588682 +0000 UTC m=+5.551373255" watchObservedRunningTime="2026-07-21 19:37:17.838994816 +0000 UTC m=+5.551779378"
Jul 21 19:37:17.987023 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.986993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pw9bq"
Jul 21 19:37:17.993834 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.993816    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpccv"
Jul 21 19:37:17.995784 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:17.995758    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bdf129_56e9_427e_b80d_5f1d748f7720.slice/crio-ef9d8bd13e4476ceec9fdc5071a8c3ae8eadb71687d6c927b7ee4a85ed3865ee WatchSource:0}: Error finding container ef9d8bd13e4476ceec9fdc5071a8c3ae8eadb71687d6c927b7ee4a85ed3865ee: Status 404 returned error can't find the container with id ef9d8bd13e4476ceec9fdc5071a8c3ae8eadb71687d6c927b7ee4a85ed3865ee
Jul 21 19:37:17.997067 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:17.996983    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49mdm"
Jul 21 19:37:18.000829 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.000809    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4851fe4_662d_4f35_b4ac_6d916ae04fa3.slice/crio-f15539a5818c37f4c55460f3560dcaae22563de9a5691e64ecaeafd29d57e24c WatchSource:0}: Error finding container f15539a5818c37f4c55460f3560dcaae22563de9a5691e64ecaeafd29d57e24c: Status 404 returned error can't find the container with id f15539a5818c37f4c55460f3560dcaae22563de9a5691e64ecaeafd29d57e24c
Jul 21 19:37:18.003092 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.003073    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wnl9k"
Jul 21 19:37:18.004086 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.004067    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64fc516_c7de_4c78_bbb2_3085168c83ae.slice/crio-415d139fd29e39521a1ec4004974c65a0eefd092153e4b6d8a79b29b0f2ed113 WatchSource:0}: Error finding container 415d139fd29e39521a1ec4004974c65a0eefd092153e4b6d8a79b29b0f2ed113: Status 404 returned error can't find the container with id 415d139fd29e39521a1ec4004974c65a0eefd092153e4b6d8a79b29b0f2ed113
Jul 21 19:37:18.008812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.008793    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:18.011139 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.011121    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080cbdb8_3732_4133_839b_390418c44c68.slice/crio-b1047cbdaef3afc7a110822e6c55bd4fcc8f46952e5cfb59d97d2b471354863d WatchSource:0}: Error finding container b1047cbdaef3afc7a110822e6c55bd4fcc8f46952e5cfb59d97d2b471354863d: Status 404 returned error can't find the container with id b1047cbdaef3afc7a110822e6c55bd4fcc8f46952e5cfb59d97d2b471354863d
Jul 21 19:37:18.012698 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.012682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx"
Jul 21 19:37:18.015925 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.015905    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804971ce_9fbd_4f02_a2f0_d670bfda1379.slice/crio-dc056ab21b0ed3700601e3de59ec362d2af4dbff38d548ee6f24d2f6540f5d33 WatchSource:0}: Error finding container dc056ab21b0ed3700601e3de59ec362d2af4dbff38d548ee6f24d2f6540f5d33: Status 404 returned error can't find the container with id dc056ab21b0ed3700601e3de59ec362d2af4dbff38d548ee6f24d2f6540f5d33
Jul 21 19:37:18.018607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.018589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvc5w"
Jul 21 19:37:18.020630 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.020611    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cfd511_184e_41bd_b6ad_d81625679e3a.slice/crio-675b5490bf7073db9e3f86ec9d526ca124d89a0757d211b8a4c181bcd5de4e3d WatchSource:0}: Error finding container 675b5490bf7073db9e3f86ec9d526ca124d89a0757d211b8a4c181bcd5de4e3d: Status 404 returned error can't find the container with id 675b5490bf7073db9e3f86ec9d526ca124d89a0757d211b8a4c181bcd5de4e3d
Jul 21 19:37:18.023646 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.023612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slgpm"
Jul 21 19:37:18.026948 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.026901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:18.027091 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.027071    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3ee25e_530d_42c4_b9b1_67664ee2001e.slice/crio-9d72debe350d8b422c56972bda1d4363f337a22518a3c284a21ac9d375cc8148 WatchSource:0}: Error finding container 9d72debe350d8b422c56972bda1d4363f337a22518a3c284a21ac9d375cc8148: Status 404 returned error can't find the container with id 9d72debe350d8b422c56972bda1d4363f337a22518a3c284a21ac9d375cc8148
Jul 21 19:37:18.030872 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.030846    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4030f7e4_0205_4571_8678_f00d0a7c50fb.slice/crio-f19d102aa5ba5f282ff78b39bc2b813716bcba0429898a30fcf18a7ddc15a1dd WatchSource:0}: Error finding container f19d102aa5ba5f282ff78b39bc2b813716bcba0429898a30fcf18a7ddc15a1dd: Status 404 returned error can't find the container with id f19d102aa5ba5f282ff78b39bc2b813716bcba0429898a30fcf18a7ddc15a1dd
Jul 21 19:37:18.035155 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:18.035135    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39a08a2_7f02_4332_adec_e44912128da2.slice/crio-280dcffa89e8523fc42fb65d141e30c260210a77fdce217545409b9304984dac WatchSource:0}: Error finding container 280dcffa89e8523fc42fb65d141e30c260210a77fdce217545409b9304984dac: Status 404 returned error can't find the container with id 280dcffa89e8523fc42fb65d141e30c260210a77fdce217545409b9304984dac
Jul 21 19:37:18.137845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.137795    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 19:32:17 +0000 UTC" deadline="2028-04-12 01:12:15.412223526 +0000 UTC"
Jul 21 19:37:18.137845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.137835    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15125h34m57.27439096s"
Jul 21 19:37:18.322820 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.322739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:18.322820 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.322785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:18.323018 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.322900    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:18.323018 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.322973    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.322958669 +0000 UTC m=+7.035743224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:18.323018 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.322904    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:18.323135 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.323032    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.323021806 +0000 UTC m=+7.035806365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:18.421655 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.421617    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-24ln4" event={"ID":"804971ce-9fbd-4f02-a2f0-d670bfda1379","Type":"ContainerStarted","Data":"dc056ab21b0ed3700601e3de59ec362d2af4dbff38d548ee6f24d2f6540f5d33"}
Jul 21 19:37:18.422641 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.422614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wnl9k" event={"ID":"080cbdb8-3732-4133-839b-390418c44c68","Type":"ContainerStarted","Data":"b1047cbdaef3afc7a110822e6c55bd4fcc8f46952e5cfb59d97d2b471354863d"}
Jul 21 19:37:18.423081 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.423062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:18.423242 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.423226    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:18.423315 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.423249    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:18.423315 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.423261    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:18.423412 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.423322    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:19.423302907 +0000 UTC m=+7.136087472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:18.423776 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.423756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pw9bq" event={"ID":"e9bdf129-56e9-427e-b80d-5f1d748f7720","Type":"ContainerStarted","Data":"ef9d8bd13e4476ceec9fdc5071a8c3ae8eadb71687d6c927b7ee4a85ed3865ee"}
Jul 21 19:37:18.424756 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.424736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"280dcffa89e8523fc42fb65d141e30c260210a77fdce217545409b9304984dac"}
Jul 21 19:37:18.426317 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.426295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slgpm" event={"ID":"4030f7e4-0205-4571-8678-f00d0a7c50fb","Type":"ContainerStarted","Data":"f19d102aa5ba5f282ff78b39bc2b813716bcba0429898a30fcf18a7ddc15a1dd"}
Jul 21 19:37:18.427707 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.427684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvc5w" event={"ID":"8e3ee25e-530d-42c4-b9b1-67664ee2001e","Type":"ContainerStarted","Data":"9d72debe350d8b422c56972bda1d4363f337a22518a3c284a21ac9d375cc8148"}
Jul 21 19:37:18.428910 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.428894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx" event={"ID":"56cfd511-184e-41bd-b6ad-d81625679e3a","Type":"ContainerStarted","Data":"675b5490bf7073db9e3f86ec9d526ca124d89a0757d211b8a4c181bcd5de4e3d"}
Jul 21 19:37:18.429825 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.429810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerStarted","Data":"415d139fd29e39521a1ec4004974c65a0eefd092153e4b6d8a79b29b0f2ed113"}
Jul 21 19:37:18.430708 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.430691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpccv" event={"ID":"c4851fe4-662d-4f35-b4ac-6d916ae04fa3","Type":"ContainerStarted","Data":"f15539a5818c37f4c55460f3560dcaae22563de9a5691e64ecaeafd29d57e24c"}
Jul 21 19:37:18.432057 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.432031    2573 generic.go:356] "Generic (PLEG): container finished" podID="8a17f8153952c59d972a5936a9e5cf68" containerID="0b31b850c73569dd65d0f6717793d49e8f7812069e4746c2478b66a6ff8ba70d" exitCode=0
Jul 21 19:37:18.432139 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.432061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal" event={"ID":"8a17f8153952c59d972a5936a9e5cf68","Type":"ContainerDied","Data":"0b31b850c73569dd65d0f6717793d49e8f7812069e4746c2478b66a6ff8ba70d"}
Jul 21 19:37:18.432287 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.432275    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:18.432396 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.432384    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:18.453636 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.453616    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 19:37:18.453773 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:18.453658    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 19:37:18.453773 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.453671    2573 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-115.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:18.453773 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:18.453708    2573 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal"
Jul 21 19:37:19.138551 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.138495    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 19:32:17 +0000 UTC" deadline="2028-03-11 02:56:26.053207717 +0000 UTC"
Jul 21 19:37:19.138551 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.138548    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14359h19m6.914663497s"
Jul 21 19:37:19.330847 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.330789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:19.331061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.330884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:19.331126 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.331073    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:19.331170 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.331135    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.331116782 +0000 UTC m=+9.043901340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:19.331523 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.331496    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:19.331612 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.331570    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.331550716 +0000 UTC m=+9.044335290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:19.409664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.409582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:19.409827 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.409752    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:19.410191 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.410172    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:19.410337 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.410266    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:19.410337 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.410328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:19.410454 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.410394    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:19.432395 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.432215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:19.432553 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.432463    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:19.432553 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.432483    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:19.432553 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.432495    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:19.432553 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:19.432548    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:21.432531264 +0000 UTC m=+9.145315817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:19.458551 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:19.458431    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal" event={"ID":"8a17f8153952c59d972a5936a9e5cf68","Type":"ContainerStarted","Data":"6b58105350f425da7ea4de8a20e6dbd7dc8124b66b4b54d854d70c22a23649f3"}
Jul 21 19:37:21.351097 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.351056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:21.351550 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.351150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:21.351550 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.351250    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:21.351550 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.351340    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.351317267 +0000 UTC m=+13.064101839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:21.351550 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.351260    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:21.351550 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.351409    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.351391594 +0000 UTC m=+13.064176167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.409586    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.409626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.409586    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.409735    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.409806    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:21.410084 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.409870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:21.452013 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:21.451971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:21.452213 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.452186    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:21.452213 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.452209    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:21.452314 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.452222    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:21.452314 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:21.452282    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:25.452265383 +0000 UTC m=+13.165049938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:23.410043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:23.410176    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:23.410244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:23.410316    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:23.410352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:23.410445 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:23.410415    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:25.382195 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.382143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:25.382647 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.382210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:25.382647 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.382348    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:25.382647 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.382412    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.382394215 +0000 UTC m=+21.095178777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:25.382901 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.382860    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:25.383049 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.382966    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.38294701 +0000 UTC m=+21.095731564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:25.409611 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.409578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:25.409786 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.409668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:25.409786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.409731    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:25.409920 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.409799    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:25.409920 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.409838    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:25.410039 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.409926    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:25.483603 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:25.483514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:25.483808 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.483704    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:25.483808 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.483793    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:25.483808 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.483808    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:25.484037 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:25.483870    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:33.48384994 +0000 UTC m=+21.196634498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:27.409695 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:27.409661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:27.410143 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:27.409904    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:27.410297 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:27.410271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:27.410426 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:27.410391    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:27.410483 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:27.410435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:27.410533 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:27.410493    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:29.409872 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:29.409839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:29.410284 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:29.409840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:29.410284 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:29.409943    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:29.410284 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:29.410040    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:29.410284 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:29.409846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:29.410284 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:29.410146    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:31.409967 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:31.409931    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:31.410472 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:31.410054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:31.410472 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:31.410063    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:31.410472 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:31.410125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:31.410472 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:31.410246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:31.410472 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:31.410351    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:33.409228 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.409187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:33.409228 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.409238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:33.409802 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.409233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:33.409802 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.409330    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:33.409802 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.409470    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:33.409802 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.409551    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:33.442167 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.442139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:33.442327 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.442182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:33.442327 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.442292    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:33.442416 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.442348    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.44233426 +0000 UTC m=+37.155118811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:33.442416 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.442292    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:33.442482 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.442422    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.442409723 +0000 UTC m=+37.155194277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:33.543188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:33.543147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:33.543393 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.543298    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:33.543393 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.543328    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:33.543393 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.543342    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:33.543561 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:33.543399    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.543384979 +0000 UTC m=+37.256169535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:35.409244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:35.409206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:35.409703 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:35.409206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:35.409703 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:35.409329    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:35.409703 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:35.409206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:35.409703 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:35.409436    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:35.409703 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:35.409540    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:37.410345 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.410173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:37.411022 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.410175    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:37.411022 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:37.410440    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:37.411022 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.410216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:37.411022 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:37.410488    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:37.411022 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:37.410567    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:37.498119 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"d69e91afa7c352989995e84045cb5d4951df9dc97beb28f67abdd158e7b05e1d"}
Jul 21 19:37:37.498407 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"0642ce699ca78e94f6b918af13d4f8c99b60f888d5ef45dea356769163e86ea4"}
Jul 21 19:37:37.498407 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"dc0f199e53de2e92174923d6acfb19aa418c2a7d3071528dbf05a7132663af7f"}
Jul 21 19:37:37.498407 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"22b13f7e04aa16beceaffe4f5dca517024e0bcefcadc741abc1045a4d7f2bfd7"}
Jul 21 19:37:37.498407 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"0b602b65ed4a38af25342ffe04308dc0d11bea4fee76774acf8cb6c1dd7a29d9"}
Jul 21 19:37:37.498407 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.498367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"67fa2c7ce0999405aa3f6547544078f654a07ea9b81568358ac09860d65244f1"}
Jul 21 19:37:37.499490 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.499467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slgpm" event={"ID":"4030f7e4-0205-4571-8678-f00d0a7c50fb","Type":"ContainerStarted","Data":"2c60cdd389d6a891b70d2ee1a68881a04fed3ed698029774b41c89d6a120f4d9"}
Jul 21 19:37:37.500866 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.500846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvc5w" event={"ID":"8e3ee25e-530d-42c4-b9b1-67664ee2001e","Type":"ContainerStarted","Data":"8010aa30b38d8813e5d0850267693035671486761219e8820676591e181b6f2f"}
Jul 21 19:37:37.502154 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.502132    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx" event={"ID":"56cfd511-184e-41bd-b6ad-d81625679e3a","Type":"ContainerStarted","Data":"bb84b8c5627891e518c72c1835c1d692bea46d8b7c38ae4fdf3022874257e51e"}
Jul 21 19:37:37.503475 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.503457    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="4bba3905a4fc2d6ff4396f4e322de489c86f789e330da6114604f4d1577bbdd9" exitCode=0
Jul 21 19:37:37.503614 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.503519    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"4bba3905a4fc2d6ff4396f4e322de489c86f789e330da6114604f4d1577bbdd9"}
Jul 21 19:37:37.504928 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.504899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpccv" event={"ID":"c4851fe4-662d-4f35-b4ac-6d916ae04fa3","Type":"ContainerStarted","Data":"a5bfd9c4ca51dac5730077be1297cb37fb13811756d8e20e3a955b0c44b44654"}
Jul 21 19:37:37.506298 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.506281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-24ln4" event={"ID":"804971ce-9fbd-4f02-a2f0-d670bfda1379","Type":"ContainerStarted","Data":"9fd19f4143cb74d6bffd2c4d8eafd75318af612fae5a042afb76293febbd7503"}
Jul 21 19:37:37.507546 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.507529    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pw9bq" event={"ID":"e9bdf129-56e9-427e-b80d-5f1d748f7720","Type":"ContainerStarted","Data":"45978c09ee992b29b6b49f833a1bd1cc38aba9743edf0120cc7478fb4507a3f3"}
Jul 21 19:37:37.517438 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.517396    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-115.ec2.internal" podStartSLOduration=20.517381698 podStartE2EDuration="20.517381698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:19.476470223 +0000 UTC m=+7.189254797" watchObservedRunningTime="2026-07-21 19:37:37.517381698 +0000 UTC m=+25.230166284"
Jul 21 19:37:37.518190 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.518149    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-slgpm" podStartSLOduration=5.174938026 podStartE2EDuration="23.518140665s" totalImagesPullingTime="18.343202639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.517008595 +0000 UTC m=+25.229793167" watchObservedRunningTime="2026-07-21 19:37:37.518140665 +0000 UTC m=+25.230925236"
Jul 21 19:37:37.538880 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.538839    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pw9bq" podStartSLOduration=5.105931538 podStartE2EDuration="23.538827182s" totalImagesPullingTime="18.432895644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.538646291 +0000 UTC m=+25.251430862" watchObservedRunningTime="2026-07-21 19:37:37.538827182 +0000 UTC m=+25.251611754"
Jul 21 19:37:37.582171 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.582133    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nvc5w" podStartSLOduration=5.236859239 podStartE2EDuration="23.582121422s" totalImagesPullingTime="18.345262183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.581976289 +0000 UTC m=+25.294760860" watchObservedRunningTime="2026-07-21 19:37:37.582121422 +0000 UTC m=+25.294905993"
Jul 21 19:37:37.635949 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.635909    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cpccv" podStartSLOduration=5.260659832 podStartE2EDuration="23.635895707s" totalImagesPullingTime="18.375235875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.60302105 +0000 UTC m=+25.315805622" watchObservedRunningTime="2026-07-21 19:37:37.635895707 +0000 UTC m=+25.348680277"
Jul 21 19:37:37.636188 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.636170    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-24ln4" podStartSLOduration=13.088559744 podStartE2EDuration="23.636164448s" totalImagesPullingTime="10.547604704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:37.635774314 +0000 UTC m=+25.348558887" watchObservedRunningTime="2026-07-21 19:37:37.636164448 +0000 UTC m=+25.348949018"
Jul 21 19:37:37.852136 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:37.852101    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 19:37:38.340537 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.340446    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T19:37:37.852131319Z","UUID":"3d70a9c9-85b1-4456-ba2b-64159be2cc49","Handler":null,"Name":"","Endpoint":""}
Jul 21 19:37:38.343061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.343038    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 19:37:38.343227 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.343081    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 19:37:38.511543 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.511507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx" event={"ID":"56cfd511-184e-41bd-b6ad-d81625679e3a","Type":"ContainerStarted","Data":"e6a9fb9bc63d105940f5778d2e1e5f7023e4ada67e6abbcb391a0bdd35853645"}
Jul 21 19:37:38.512920 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.512856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wnl9k" event={"ID":"080cbdb8-3732-4133-839b-390418c44c68","Type":"ContainerStarted","Data":"b002c36d99042f8d8646a0d2b0936fd4ca9a709e50ea3c969b9508839a134c50"}
Jul 21 19:37:38.529621 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:38.529583    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wnl9k" podStartSLOduration=6.168203102 podStartE2EDuration="24.529571724s" totalImagesPullingTime="18.361368622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:38.529429447 +0000 UTC m=+26.242214018" watchObservedRunningTime="2026-07-21 19:37:38.529571724 +0000 UTC m=+26.242356296"
Jul 21 19:37:39.409844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:39.409803    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:39.409844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:39.409837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:39.410060 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:39.409812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:39.410060 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:39.409936    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:39.410060 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:39.410029    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:39.410219 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:39.410101    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:39.517836 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:39.517750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"8b1a57d52349f09d00af0eace9e1f85d5fea7758ba13d46391a0c925a0a1155e"}
Jul 21 19:37:39.519645 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:39.519611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx" event={"ID":"56cfd511-184e-41bd-b6ad-d81625679e3a","Type":"ContainerStarted","Data":"d0147169f9479f003748b5ec45613dc9715b6429d72aaf4d99213765e08570af"}
Jul 21 19:37:40.177754 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:40.177711    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:40.178291 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:40.178271    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:40.202332 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:40.202275    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hc2bx" podStartSLOduration=5.712842771 podStartE2EDuration="26.202260622s" totalImagesPullingTime="20.489417851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:39.543347941 +0000 UTC m=+27.256132515" watchObservedRunningTime="2026-07-21 19:37:40.202260622 +0000 UTC m=+27.915045195"
Jul 21 19:37:40.522377 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:40.522113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:40.522794 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:40.522758    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-24ln4"
Jul 21 19:37:41.409676 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:41.409640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:41.409918 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:41.409648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:41.409918 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:41.409648    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:41.409918 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:41.409789    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:41.409918 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:41.409880    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:41.410152 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:41.409946    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:43.410252 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.410159    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:43.410910 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.410169    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:43.410910 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:43.410296    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:43.410910 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.410265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:43.410910 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:43.410361    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:43.410910 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:43.410421    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:43.531440 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.531404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" event={"ID":"d39a08a2-7f02-4332-adec-e44912128da2","Type":"ContainerStarted","Data":"ed251a201b9d5e7e35edd223d1daac88e1c923dbd8d272fade9eb276c9b8018c"}
Jul 21 19:37:43.531765 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.531740    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:43.531889 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.531845    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:43.533445 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.533422    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="79ac5306cf160739c5ae2b77172cb02366110d2be7fc32e7e6397f6f66588104" exitCode=0
Jul 21 19:37:43.533546 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.533464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"79ac5306cf160739c5ae2b77172cb02366110d2be7fc32e7e6397f6f66588104"}
Jul 21 19:37:43.547353 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.547333    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:43.547735 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.547706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:43.563937 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:43.563894    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b" podStartSLOduration=11.147874273 podStartE2EDuration="29.563880176s" totalImagesPullingTime="18.416005903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:43.562055085 +0000 UTC m=+31.274839659" watchObservedRunningTime="2026-07-21 19:37:43.563880176 +0000 UTC m=+31.276664754"
Jul 21 19:37:44.536561 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.536533    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:37:44.910271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.910238    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rm4nq"]
Jul 21 19:37:44.910384 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.910367    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:44.910557 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:44.910477    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:44.913405 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.913381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27rts"]
Jul 21 19:37:44.913512 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.913498    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:44.913630 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:44.913609    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:44.915708 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.915685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhb84"]
Jul 21 19:37:44.915835 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:44.915821    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:44.915971 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:44.915931    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:45.541087 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:45.541056    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="d51f5a5137ca6e34984628a76d47dce73a69732e7aa29b1a1fe88d53a67f3525" exitCode=0
Jul 21 19:37:45.541605 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:45.541136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"d51f5a5137ca6e34984628a76d47dce73a69732e7aa29b1a1fe88d53a67f3525"}
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:46.409711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:46.409742    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:46.409711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:46.409879    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:46.409996    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:46.410221 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:46.410068    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:46.545536 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:46.545374    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerStarted","Data":"30be74d67071e3312c9b2304a1d27af5baf270a5d8b6bab41a5d01236f49ee43"}
Jul 21 19:37:47.550209 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:47.550170    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="30be74d67071e3312c9b2304a1d27af5baf270a5d8b6bab41a5d01236f49ee43" exitCode=0
Jul 21 19:37:47.550561 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:47.550213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"30be74d67071e3312c9b2304a1d27af5baf270a5d8b6bab41a5d01236f49ee43"}
Jul 21 19:37:48.415732 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:48.415683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:48.415915 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:48.415816    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm4nq" podUID="90c50097-f13b-49ee-b90b-73c984d779e6"
Jul 21 19:37:48.415984 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:48.415938    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:48.416035 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:48.416011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:48.416168 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:48.416148    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27rts" podUID="51b8a292-988f-4f34-bcf9-8f3e8d99519d"
Jul 21 19:37:48.416304 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:48.416273    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhb84" podUID="5074fdf4-ca29-4d4c-b09a-9b0c79a485f3"
Jul 21 19:37:49.100626 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.100591    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-115.ec2.internal" event="NodeReady"
Jul 21 19:37:49.101116 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.100766    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 19:37:49.145917 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.145886    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:37:49.147704 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.147684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.152159 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.151942    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 19:37:49.152159 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.151971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7l5zt\""
Jul 21 19:37:49.152159 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.151942    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 19:37:49.152430 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.152236    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 19:37:49.159195 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.159167    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 19:37:49.166801 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.166744    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:37:49.170486 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.170458    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nhd92"]
Jul 21 19:37:49.172264 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.172246    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z72kl"]
Jul 21 19:37:49.172402 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.172374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.174197 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.174178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.175132 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.175111    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 19:37:49.175636 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.175617    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 19:37:49.175744 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.175618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 19:37:49.175744 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.175676    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zpj99\""
Jul 21 19:37:49.177689 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.177669    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 19:37:49.177854 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.177690    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 19:37:49.177854 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.177694    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46cqs\""
Jul 21 19:37:49.184227 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.184204    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nhd92"]
Jul 21 19:37:49.189624 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.189602    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z72kl"]
Jul 21 19:37:49.261011 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.260979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd0b194b-49af-4709-b1c4-768e6739264e-cert\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.261152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.261275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7022438-4ba5-472b-ad33-edbe05ddf92a-tmp-dir\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.261275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjhk\" (UniqueName: \"kubernetes.io/projected/f7022438-4ba5-472b-ad33-edbe05ddf92a-kube-api-access-xfjhk\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.261275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mldxj\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.261498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7022438-4ba5-472b-ad33-edbe05ddf92a-config-volume\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.261498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.261434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8qn\" (UniqueName: \"kubernetes.io/projected/dd0b194b-49af-4709-b1c4-768e6739264e-kube-api-access-jx8qn\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.362728 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7022438-4ba5-472b-ad33-edbe05ddf92a-tmp-dir\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjhk\" (UniqueName: \"kubernetes.io/projected/f7022438-4ba5-472b-ad33-edbe05ddf92a-kube-api-access-xfjhk\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.362921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.362926    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mldxj\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.362984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7022438-4ba5-472b-ad33-edbe05ddf92a-config-volume\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8qn\" (UniqueName: \"kubernetes.io/projected/dd0b194b-49af-4709-b1c4-768e6739264e-kube-api-access-jx8qn\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd0b194b-49af-4709-b1c4-768e6739264e-cert\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7022438-4ba5-472b-ad33-edbe05ddf92a-tmp-dir\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.363334 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.363252    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.863229174 +0000 UTC m=+37.576013738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:37:49.363795 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.363590    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:37:49.363795 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.363607    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:37:49.363795 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.363664    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:37:49.863649354 +0000 UTC m=+37.576433905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:37:49.363993 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.363966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7022438-4ba5-472b-ad33-edbe05ddf92a-config-volume\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.364488 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.364287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.364488 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.364447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.364671 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.364646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.367572 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.367550    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.367666 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.367585    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.367666 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.367647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd0b194b-49af-4709-b1c4-768e6739264e-cert\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.375067 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.375042    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.381828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.379355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mldxj\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.381828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.380908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8qn\" (UniqueName: \"kubernetes.io/projected/dd0b194b-49af-4709-b1c4-768e6739264e-kube-api-access-jx8qn\") pod \"ingress-canary-nhd92\" (UID: \"dd0b194b-49af-4709-b1c4-768e6739264e\") " pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.383429 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.383406    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjhk\" (UniqueName: \"kubernetes.io/projected/f7022438-4ba5-472b-ad33-edbe05ddf92a-kube-api-access-xfjhk\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.464307 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.464243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:49.464490 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.464339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:49.464490 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.464373    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:49.464490 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.464435    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.46441794 +0000 UTC m=+69.177202511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 19:37:49.464490 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.464471    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:49.464668 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.464541    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret podName:90c50097-f13b-49ee-b90b-73c984d779e6 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.464524322 +0000 UTC m=+69.177308887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret") pod "global-pull-secret-syncer-rm4nq" (UID: "90c50097-f13b-49ee-b90b-73c984d779e6") : object "kube-system"/"original-pull-secret" not registered
Jul 21 19:37:49.484569 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.484540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nhd92"
Jul 21 19:37:49.565314 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.565276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:49.565544 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.565523    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 19:37:49.565621 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.565551    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 19:37:49.565621 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.565565    2573 projected.go:196] Error preparing data for projected volume kube-api-access-9qpsx for pod openshift-network-diagnostics/network-check-target-27rts: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:49.565744 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.565622    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx podName:51b8a292-988f-4f34-bcf9-8f3e8d99519d nodeName:}" failed. No retries permitted until 2026-07-21 19:38:21.565604374 +0000 UTC m=+69.278388930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9qpsx" (UniqueName: "kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx") pod "network-check-target-27rts" (UID: "51b8a292-988f-4f34-bcf9-8f3e8d99519d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 19:37:49.630853 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.630821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nhd92"]
Jul 21 19:37:49.635467 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:37:49.635433    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0b194b_49af_4709_b1c4_768e6739264e.slice/crio-97e13e504e6407179682020e5ebd98ac918c6eb23d36920130a4a9d883dabfad WatchSource:0}: Error finding container 97e13e504e6407179682020e5ebd98ac918c6eb23d36920130a4a9d883dabfad: Status 404 returned error can't find the container with id 97e13e504e6407179682020e5ebd98ac918c6eb23d36920130a4a9d883dabfad
Jul 21 19:37:49.867563 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.867476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:49.867563 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:49.867534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:49.867786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.867627    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:37:49.867786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.867667    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:37:49.867786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.867677    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:37:49.867786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.867694    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:50.86767701 +0000 UTC m=+38.580461565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:37:49.867786 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:49.867738    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:37:50.867709068 +0000 UTC m=+38.580493641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:37:50.412767 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.412734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:37:50.413587 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.412772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:37:50.413587 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.412771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:37:50.417061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.416860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 19:37:50.417061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.416874    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 19:37:50.417061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.416931    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tcjpf\""
Jul 21 19:37:50.417061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.416860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 19:37:50.417061 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.416935    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmxjk\""
Jul 21 19:37:50.417390 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.417203    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 19:37:50.560648 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.560614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nhd92" event={"ID":"dd0b194b-49af-4709-b1c4-768e6739264e","Type":"ContainerStarted","Data":"97e13e504e6407179682020e5ebd98ac918c6eb23d36920130a4a9d883dabfad"}
Jul 21 19:37:50.876748 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.876698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:50.876953 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:50.876767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:50.876953 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:50.876863    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:37:50.876953 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:50.876934    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:37:50.876953 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:50.876956    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:37:50.877163 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:50.876946    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:52.876922831 +0000 UTC m=+40.589707416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:37:50.877163 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:50.877021    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:37:52.877004229 +0000 UTC m=+40.589788789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:37:52.568382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:52.568174    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="13c9c46f5b3b08b2133e1eb19aef5969a5eadabe540b644b47196c3e98c5c3c4" exitCode=0
Jul 21 19:37:52.568382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:52.568247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"13c9c46f5b3b08b2133e1eb19aef5969a5eadabe540b644b47196c3e98c5c3c4"}
Jul 21 19:37:52.893340 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:52.893247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:52.893340 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:52.893311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:52.893551 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:52.893432    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:37:52.893551 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:52.893449    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:37:52.893551 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:52.893463    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:37:52.893551 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:52.893516    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:37:56.893493555 +0000 UTC m=+44.606278108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:37:52.893551 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:52.893536    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:37:56.893526297 +0000 UTC m=+44.606310853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:37:53.573628 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:53.573600    2573 generic.go:356] "Generic (PLEG): container finished" podID="b64fc516-c7de-4c78-bbb2-3085168c83ae" containerID="17880216ea21293c12e5096f15ce3da4f244fddf9d70f97d92e64d08864b6be8" exitCode=0
Jul 21 19:37:53.573628 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:53.573633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerDied","Data":"17880216ea21293c12e5096f15ce3da4f244fddf9d70f97d92e64d08864b6be8"}
Jul 21 19:37:53.971795 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:53.971759    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:54.057196 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.057160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:54.579020 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.578987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mdm" event={"ID":"b64fc516-c7de-4c78-bbb2-3085168c83ae","Type":"ContainerStarted","Data":"e704e73f17bb7ccd22d3240ec5a0a31b043c556de83413cc17d485877031d4fb"}
Jul 21 19:37:54.603168 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.603073    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-49mdm" podStartSLOduration=10.330842869 podStartE2EDuration="40.603057327s" totalImagesPullingTime="30.272214458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:54.601390307 +0000 UTC m=+42.314174880" watchObservedRunningTime="2026-07-21 19:37:54.603057327 +0000 UTC m=+42.315841899"
Jul 21 19:37:54.724741 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.724691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:54.811947 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.811893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:54.909149 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:54.909064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:55.010161 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:55.010114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:55.584920 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:55.584886    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nhd92" event={"ID":"dd0b194b-49af-4709-b1c4-768e6739264e","Type":"ContainerStarted","Data":"2fb989b9c916c8b612f5092d332f99735556847d42970562f258be3f2f71f906"}
Jul 21 19:37:55.604362 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:55.604311    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nhd92" podStartSLOduration=1.583519474 podStartE2EDuration="6.604296994s" totalImagesPullingTime="5.02077752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:37:55.602787267 +0000 UTC m=+43.315571861" watchObservedRunningTime="2026-07-21 19:37:55.604296994 +0000 UTC m=+43.317081566"
Jul 21 19:37:56.928270 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:56.928226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:37:56.928270 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:56.928274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:37:56.928682 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:56.928373    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:37:56.928682 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:56.928377    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:37:56.928682 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:56.928440    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:04.928426127 +0000 UTC m=+52.641210678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:37:56.928682 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:56.928384    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:37:56.928682 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:37:56.928521    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:38:04.928509374 +0000 UTC m=+52.641293925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:37:56.986375 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:56.986337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:57.105050 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:57.105017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:59.006517 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:59.006480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:37:59.941494 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:37:59.941465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:00.044893 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:00.044861    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:04.989235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:04.989196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:04.989256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:04.989359    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:04.989369    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:04.989367    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:04.989419    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:38:20.989406566 +0000 UTC m=+68.702191117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:38:04.989695 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:04.989446    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:20.989427184 +0000 UTC m=+68.702211755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:38:15.554174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:15.554148    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qc2b"
Jul 21 19:38:15.705016 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:15.704982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:15.806285 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:15.806206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:15.910144 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:15.910108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:15.964691 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:15.964661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:16.022400 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:16.022362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:18.905185 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:18.905152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:18.993035 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:18.993008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:20.999524 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:20.999489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:20.999583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:20.999646    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:20.999664    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5449568b-qz4qf: secret "image-registry-tls" not found
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:20.999670    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:20.999755    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls podName:9a6f2a2d-0dd0-49f5-8064-89880fece95e nodeName:}" failed. No retries permitted until 2026-07-21 19:38:52.999731661 +0000 UTC m=+100.712516226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls") pod "image-registry-c5449568b-qz4qf" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e") : secret "image-registry-tls" not found
Jul 21 19:38:21.000017 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:20.999771    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls podName:f7022438-4ba5-472b-ad33-edbe05ddf92a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:52.999765117 +0000 UTC m=+100.712549668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls") pod "dns-default-z72kl" (UID: "f7022438-4ba5-472b-ad33-edbe05ddf92a") : secret "dns-default-metrics-tls" not found
Jul 21 19:38:21.502587 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.502554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:38:21.502752 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.502606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:38:21.505496 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.505476    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 19:38:21.505556 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.505540    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 19:38:21.513631 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:21.513612    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 19:38:21.513690 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:21.513679    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs podName:5074fdf4-ca29-4d4c-b09a-9b0c79a485f3 nodeName:}" failed. No retries permitted until 2026-07-21 19:39:25.513658174 +0000 UTC m=+133.226442726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs") pod "network-metrics-daemon-rhb84" (UID: "5074fdf4-ca29-4d4c-b09a-9b0c79a485f3") : secret "metrics-daemon-secret" not found
Jul 21 19:38:21.516946 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.516925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90c50097-f13b-49ee-b90b-73c984d779e6-original-pull-secret\") pod \"global-pull-secret-syncer-rm4nq\" (UID: \"90c50097-f13b-49ee-b90b-73c984d779e6\") " pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:38:21.603835 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.603802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:38:21.610958 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.610936    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 19:38:21.617945 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.617919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 19:38:21.627726 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.627686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qpsx\" (UniqueName: \"kubernetes.io/projected/51b8a292-988f-4f34-bcf9-8f3e8d99519d-kube-api-access-9qpsx\") pod \"network-check-target-27rts\" (UID: \"51b8a292-988f-4f34-bcf9-8f3e8d99519d\") " pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:38:21.636595 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.636579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm4nq"
Jul 21 19:38:21.755921 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.755846    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rm4nq"]
Jul 21 19:38:21.759249 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:21.759220    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c50097_f13b_49ee_b90b_73c984d779e6.slice/crio-83699c1721fe126b3867bd770f3b364253c8660a0dff95b49d1c15cbd7be762a WatchSource:0}: Error finding container 83699c1721fe126b3867bd770f3b364253c8660a0dff95b49d1c15cbd7be762a: Status 404 returned error can't find the container with id 83699c1721fe126b3867bd770f3b364253c8660a0dff95b49d1c15cbd7be762a
Jul 21 19:38:21.927180 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.927143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmxjk\""
Jul 21 19:38:21.935041 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:21.935018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:38:22.069017 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:22.068986    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27rts"]
Jul 21 19:38:22.072241 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:22.072214    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b8a292_988f_4f34_bcf9_8f3e8d99519d.slice/crio-d7568dd54b4d0aff7b5ad3cacff28f648dce586b6caaf1a5fed27edbd4047153 WatchSource:0}: Error finding container d7568dd54b4d0aff7b5ad3cacff28f648dce586b6caaf1a5fed27edbd4047153: Status 404 returned error can't find the container with id d7568dd54b4d0aff7b5ad3cacff28f648dce586b6caaf1a5fed27edbd4047153
Jul 21 19:38:22.652465 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:22.652397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rm4nq" event={"ID":"90c50097-f13b-49ee-b90b-73c984d779e6","Type":"ContainerStarted","Data":"83699c1721fe126b3867bd770f3b364253c8660a0dff95b49d1c15cbd7be762a"}
Jul 21 19:38:22.653803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:22.653774    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27rts" event={"ID":"51b8a292-988f-4f34-bcf9-8f3e8d99519d","Type":"ContainerStarted","Data":"d7568dd54b4d0aff7b5ad3cacff28f648dce586b6caaf1a5fed27edbd4047153"}
Jul 21 19:38:23.009164 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.009129    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-549576786b-wcctq"]
Jul 21 19:38:23.033692 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.033353    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.033692 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.033428    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-549576786b-wcctq"]
Jul 21 19:38:23.036015 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.035990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 19:38:23.037266 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.037243    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 19:38:23.037351 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.037334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lsp6x\""
Jul 21 19:38:23.037540 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.037513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 19:38:23.037744 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.037513    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 19:38:23.038889 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.038861    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 19:38:23.038991 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.038933    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 19:38:23.116803 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.116764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.117240 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.116813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2sv\" (UniqueName: \"kubernetes.io/projected/7e30b05e-c759-491a-a39f-152acafe84d1-kube-api-access-fs2sv\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.117240 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.116916    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.117240 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.116976    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-stats-auth\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.117240 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.117009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-default-certificate\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.217866 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.217785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-stats-auth\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.218038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.217883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-default-certificate\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.218038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.217989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.218038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.218013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2sv\" (UniqueName: \"kubernetes.io/projected/7e30b05e-c759-491a-a39f-152acafe84d1-kube-api-access-fs2sv\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.218165 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.218081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.218165 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.218131    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:23.218229 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.218215    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:23.718191154 +0000 UTC m=+71.430975718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:23.218319 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.218291    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:23.718272761 +0000 UTC m=+71.431057327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:23.220902 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.220878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-stats-auth\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.221593 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.221569    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-default-certificate\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.229468 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.229438    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2sv\" (UniqueName: \"kubernetes.io/projected/7e30b05e-c759-491a-a39f-152acafe84d1-kube-api-access-fs2sv\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.262178 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.262081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:23.344383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.344319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:23.722334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.722288    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.722507 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:23.722414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:23.722507 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.722494    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:24.722471728 +0000 UTC m=+72.435256285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:23.722611 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.722581    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:23.722674 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:23.722661    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:24.722642661 +0000 UTC m=+72.435427221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:24.732836 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:24.732796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:24.733262 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:24.732906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:24.733262 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:24.732985    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:26.732966149 +0000 UTC m=+74.445750714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:24.733262 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:24.733031    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:24.733262 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:24.733085    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:26.733071994 +0000 UTC m=+74.445856548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:26.668130 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.668088    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rm4nq" event={"ID":"90c50097-f13b-49ee-b90b-73c984d779e6","Type":"ContainerStarted","Data":"f632f9eec8be473fb637882746efce76f716c4ba0f39bd3522422106817f7b89"}
Jul 21 19:38:26.669730 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.669685    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27rts" event={"ID":"51b8a292-988f-4f34-bcf9-8f3e8d99519d","Type":"ContainerStarted","Data":"25de4acf02f62f937e9ea406353d9e3897138e419aee23d28136de8760cb1674"}
Jul 21 19:38:26.669844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.669827    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:38:26.685381 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.685328    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rm4nq" podStartSLOduration=67.942455058 podStartE2EDuration="1m12.685311793s" totalImagesPullingTime="4.742856735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:26.684496023 +0000 UTC m=+74.397280620" watchObservedRunningTime="2026-07-21 19:38:26.685311793 +0000 UTC m=+74.398096343"
Jul 21 19:38:26.701535 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.701488    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-27rts" podStartSLOduration=68.274430158 podStartE2EDuration="1m12.701470174s" totalImagesPullingTime="4.427040016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:26.700456307 +0000 UTC m=+74.413240879" watchObservedRunningTime="2026-07-21 19:38:26.701470174 +0000 UTC m=+74.414254724"
Jul 21 19:38:26.750011 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.749918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:26.750011 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:26.750005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:26.750198 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:26.750015    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:26.750198 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:26.750087    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:30.750068604 +0000 UTC m=+78.462853171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:26.750198 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:26.750105    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:30.750097029 +0000 UTC m=+78.462881583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:27.917627 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:27.917595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:27.972187 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:27.972141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:29.350354 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:29.350312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:29.410125 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:29.410092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:30.780270 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:30.780218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:30.780662 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:30.780286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:30.780662 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:30.780371    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:30.780662 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:30.780419    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:38.780402842 +0000 UTC m=+86.493187406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:30.780662 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:30.780440    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:38.780433557 +0000 UTC m=+86.493218108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:31.590019 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.589984    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rqkvv"]
Jul 21 19:38:31.592950 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.592928    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.595894 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.595870    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 19:38:31.597319 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.597297    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 19:38:31.597319 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.597308    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 19:38:31.597474 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.597303    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 19:38:31.597474 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.597302    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hqhr5\""
Jul 21 19:38:31.620400 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.620375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqkvv"]
Jul 21 19:38:31.627498 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.627470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:31.688452 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.688422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-data-volume\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.688452 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.688453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545sr\" (UniqueName: \"kubernetes.io/projected/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-api-access-545sr\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.688653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.688489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-crio-socket\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.688653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.688506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.688653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.688635    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.693235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.693212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:31.789634 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-data-volume\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545sr\" (UniqueName: \"kubernetes.io/projected/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-api-access-545sr\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-crio-socket\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:31.789790    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:31.789823    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.789840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-crio-socket\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:31.789868    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:32.289850244 +0000 UTC m=+80.002634800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:31.789897    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:32.289877993 +0000 UTC m=+80.002662558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : configmap "kube-rbac-proxy" not found
Jul 21 19:38:31.790094 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.790057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-data-volume\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:31.807841 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:31.807806    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-545sr\" (UniqueName: \"kubernetes.io/projected/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-api-access-545sr\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:32.096918 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.096883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:32.214999 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.214951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:32.293235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.293200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:32.293410 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.293275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:32.293410 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:32.293334    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 19:38:32.293410 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:32.293350    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:32.293410 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:32.293398    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:33.293385055 +0000 UTC m=+81.006169606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:32.293410 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:32.293412    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:33.293405233 +0000 UTC m=+81.006189784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : configmap "kube-rbac-proxy" not found
Jul 21 19:38:32.313857 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.313821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:32.414601 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:32.414524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:33.301599 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.301537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:33.302011 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:33.301694    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:33.302011 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.301741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:33.302011 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:33.301766    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:35.301749237 +0000 UTC m=+83.014533791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:33.302011 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:33.301803    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 19:38:33.302011 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:33.301845    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:35.301834322 +0000 UTC m=+83.014618877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : configmap "kube-rbac-proxy" not found
Jul 21 19:38:33.749297 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.749270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slgpm_4030f7e4-0205-4571-8678-f00d0a7c50fb/dns-node-resolver/0.log"
Jul 21 19:38:33.980228 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.980194    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vrvwr"]
Jul 21 19:38:33.982951 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.982933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:33.987933 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.987483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 19:38:33.987933 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.987776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-98mwh\""
Jul 21 19:38:33.987933 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.987861    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 19:38:33.988158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.988071    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 19:38:33.988158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.988079    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 19:38:33.994764 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:33.994743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vrvwr"]
Jul 21 19:38:34.021818 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.021736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:34.085694 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.085668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:34.106937 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.106915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnz6b\" (UniqueName: \"kubernetes.io/projected/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-kube-api-access-vnz6b\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.107023 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.106942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-cabundle\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.107023 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.106979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-key\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.208223 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.208190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnz6b\" (UniqueName: \"kubernetes.io/projected/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-kube-api-access-vnz6b\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.208330 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.208225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-cabundle\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.208330 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.208275    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-key\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.208988 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.208966    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-cabundle\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.210676 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.210655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-signing-key\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.217254 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.217231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnz6b\" (UniqueName: \"kubernetes.io/projected/3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357-kube-api-access-vnz6b\") pod \"service-ca-58598695f7-vrvwr\" (UID: \"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357\") " pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.293259 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.293173    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-vrvwr"
Jul 21 19:38:34.415931 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.415831    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-vrvwr"]
Jul 21 19:38:34.418906 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:34.418876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3509cbf5_1d4d_4fe6_a6e5_fc03dfc7e357.slice/crio-583108dab070f5455f39a19777bbbd8fdefd73b69d62294934e0241e20b998fc WatchSource:0}: Error finding container 583108dab070f5455f39a19777bbbd8fdefd73b69d62294934e0241e20b998fc: Status 404 returned error can't find the container with id 583108dab070f5455f39a19777bbbd8fdefd73b69d62294934e0241e20b998fc
Jul 21 19:38:34.689371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.689281    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-vrvwr" event={"ID":"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357","Type":"ContainerStarted","Data":"583108dab070f5455f39a19777bbbd8fdefd73b69d62294934e0241e20b998fc"}
Jul 21 19:38:34.752653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:34.752629    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvc5w_8e3ee25e-530d-42c4-b9b1-67664ee2001e/node-ca/0.log"
Jul 21 19:38:35.006366 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:35.006315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:35.319100 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:35.319008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:35.319271 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:35.319149    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 19:38:35.319271 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:35.319212    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:39.319196742 +0000 UTC m=+87.031981297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : configmap "kube-rbac-proxy" not found
Jul 21 19:38:35.319271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:35.319148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:35.319271 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:35.319243    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:35.319461 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:35.319304    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:39.319287711 +0000 UTC m=+87.032072281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:35.352705 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:35.352658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nhd92_dd0b194b-49af-4709-b1c4-768e6739264e/serve-healthcheck-canary/0.log"
Jul 21 19:38:36.695983 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:36.695898    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-vrvwr" event={"ID":"3509cbf5-1d4d-4fe6-a6e5-fc03dfc7e357","Type":"ContainerStarted","Data":"b3e7a776e2e781e2527fa4d20bcc8117dd81bde304f43eff94d7d0cb4839fa20"}
Jul 21 19:38:36.713346 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:36.713299    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-vrvwr" podStartSLOduration=1.828797166 podStartE2EDuration="3.713284234s" totalImagesPullingTime="1.884487068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:36.712077848 +0000 UTC m=+84.424862423" watchObservedRunningTime="2026-07-21 19:38:36.713284234 +0000 UTC m=+84.426068807"
Jul 21 19:38:37.926514 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:37.926463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.074263 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.074226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.174296 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.174261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.276891 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.276837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.358334 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.358301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.537844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.537746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.829972 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.829874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:38.848421 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.848390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:38.848576 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:38.848525    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:38.848576 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:38.848551    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 19:38:38.848664 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:38.848621    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:54.848602098 +0000 UTC m=+102.561386653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : secret "router-metrics-certs-default" not found
Jul 21 19:38:38.848664 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:38.848659    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle podName:7e30b05e-c759-491a-a39f-152acafe84d1 nodeName:}" failed. No retries permitted until 2026-07-21 19:38:54.848645795 +0000 UTC m=+102.561430346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle") pod "router-default-549576786b-wcctq" (UID: "7e30b05e-c759-491a-a39f-152acafe84d1") : configmap references non-existent config key: service-ca.crt
Jul 21 19:38:39.353047 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:39.353014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:39.353514 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:39.353060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:39.353514 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:39.353179    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:39.353514 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:39.353212    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 19:38:39.353514 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:39.353256    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:47.353235502 +0000 UTC m=+95.066020054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:39.353514 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:39.353278    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:38:47.353267537 +0000 UTC m=+95.066052091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : configmap "kube-rbac-proxy" not found
Jul 21 19:38:39.496112 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:39.496075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:39.641192 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:39.641103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:40.021222 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:40.021181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:40.870979 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:40.870940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:41.021307 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:41.021268    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:41.237524 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:41.237488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:41.624105 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:41.624023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:42.066172 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:42.066134    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:42.220419 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:42.220390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:42.625394 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:42.625362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:42.689678 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:42.689643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:43.024500 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:43.024464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:43.421497 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:43.421402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:43.622754 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:43.622710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:43.819246 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:43.819202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:44.241777 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:44.241709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:44.623086 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:44.622978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:44.743160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:44.743106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:44.940751 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:44.940636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:45.041301 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:45.041270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:45.112895 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:45.112863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:45.266801 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:45.266766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:45.457924 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:45.457893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:45.814474 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:45.814440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:46.026079 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:46.026047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:46.626249 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:46.626208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:46.884570 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:46.884463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:47.230464 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.230432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:47.421054 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.421005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:47.425041 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.425021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:47.425112 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.425085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:47.425164 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:47.425148    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:47.425222 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:38:47.425212    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls podName:0a50bd7c-e332-4367-ae6b-4e52d9feb79a nodeName:}" failed. No retries permitted until 2026-07-21 19:39:03.425195443 +0000 UTC m=+111.137980004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rqkvv" (UID: "0a50bd7c-e332-4367-ae6b-4e52d9feb79a") : secret "insights-runtime-extractor-tls" not found
Jul 21 19:38:47.425750 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.425711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:38:47.632159 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:47.632066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.025807 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.025757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.261779 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.261743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.362660 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.362573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.463229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.463193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.565934 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.565907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.665160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.665079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.747199 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.747164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:48.848096 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:48.848063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:49.356166 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:49.356136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:49.993599 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:49.993570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:50.063764 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:50.063710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:50.162396 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:50.162361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:50.222578 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:50.222544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:52.766416 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:52.766384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:52.877226 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:52.877193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:53.072278 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.072185    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:53.072278 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.072241    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:53.074614 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.074577    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7022438-4ba5-472b-ad33-edbe05ddf92a-metrics-tls\") pod \"dns-default-z72kl\" (UID: \"f7022438-4ba5-472b-ad33-edbe05ddf92a\") " pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:53.074730 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.074641    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"image-registry-c5449568b-qz4qf\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") " pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:53.094198 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.094172    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46cqs\""
Jul 21 19:38:53.101739 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.101706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:53.227378 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.227226    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z72kl"]
Jul 21 19:38:53.229879 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:53.229849    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7022438_4ba5_472b_ad33_edbe05ddf92a.slice/crio-19fd2589278c1fe2bf84aa04a372c7c905ba3f865c24e0e36d91c491cb6aa3c5 WatchSource:0}: Error finding container 19fd2589278c1fe2bf84aa04a372c7c905ba3f865c24e0e36d91c491cb6aa3c5: Status 404 returned error can't find the container with id 19fd2589278c1fe2bf84aa04a372c7c905ba3f865c24e0e36d91c491cb6aa3c5
Jul 21 19:38:53.362621 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.362538    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7l5zt\""
Jul 21 19:38:53.369515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.369498    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:53.518043 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.518010    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:38:53.521564 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:53.521535    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6f2a2d_0dd0_49f5_8064_89880fece95e.slice/crio-03fc0704a35bbcf23ef0a61491d883c96501d97c3c48f983339912481e2909a1 WatchSource:0}: Error finding container 03fc0704a35bbcf23ef0a61491d883c96501d97c3c48f983339912481e2909a1: Status 404 returned error can't find the container with id 03fc0704a35bbcf23ef0a61491d883c96501d97c3c48f983339912481e2909a1
Jul 21 19:38:53.745630 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.745592    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72kl" event={"ID":"f7022438-4ba5-472b-ad33-edbe05ddf92a","Type":"ContainerStarted","Data":"19fd2589278c1fe2bf84aa04a372c7c905ba3f865c24e0e36d91c491cb6aa3c5"}
Jul 21 19:38:53.746960 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.746926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" event={"ID":"9a6f2a2d-0dd0-49f5-8064-89880fece95e","Type":"ContainerStarted","Data":"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"}
Jul 21 19:38:53.747063 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.746980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" event={"ID":"9a6f2a2d-0dd0-49f5-8064-89880fece95e","Type":"ContainerStarted","Data":"03fc0704a35bbcf23ef0a61491d883c96501d97c3c48f983339912481e2909a1"}
Jul 21 19:38:53.747063 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.747027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:38:53.768223 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:53.768174    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" podStartSLOduration=99.768159391 podStartE2EDuration="1m39.768159391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:53.767350284 +0000 UTC m=+101.480134879" watchObservedRunningTime="2026-07-21 19:38:53.768159391 +0000 UTC m=+101.480943965"
Jul 21 19:38:54.887413 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:54.887322    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:54.887413 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:54.887399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:54.888149 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:54.888108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e30b05e-c759-491a-a39f-152acafe84d1-service-ca-bundle\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:54.890535 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:54.890512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e30b05e-c759-491a-a39f-152acafe84d1-metrics-certs\") pod \"router-default-549576786b-wcctq\" (UID: \"7e30b05e-c759-491a-a39f-152acafe84d1\") " pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:55.146626 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.146540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:55.374419 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.374392    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-549576786b-wcctq"]
Jul 21 19:38:55.377483 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:55.377450    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e30b05e_c759_491a_a39f_152acafe84d1.slice/crio-8d0de4a4806ebe4b8cb0565730710776c7bf498f3184cd70de6e82f64ab53d16 WatchSource:0}: Error finding container 8d0de4a4806ebe4b8cb0565730710776c7bf498f3184cd70de6e82f64ab53d16: Status 404 returned error can't find the container with id 8d0de4a4806ebe4b8cb0565730710776c7bf498f3184cd70de6e82f64ab53d16
Jul 21 19:38:55.758591 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.758554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72kl" event={"ID":"f7022438-4ba5-472b-ad33-edbe05ddf92a","Type":"ContainerStarted","Data":"673054a2e9deb0db23a96a74afb93b62dcff9fdba251ae2f3a0b9cb4b53d8777"}
Jul 21 19:38:55.758815 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.758638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z72kl" event={"ID":"f7022438-4ba5-472b-ad33-edbe05ddf92a","Type":"ContainerStarted","Data":"e934e87856ab4072e27e9c08f672ba8004765e0d57e6abeca90c9353691fea76"}
Jul 21 19:38:55.758815 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.758668    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z72kl"
Jul 21 19:38:55.760050 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.760027    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-549576786b-wcctq" event={"ID":"7e30b05e-c759-491a-a39f-152acafe84d1","Type":"ContainerStarted","Data":"8d75e96a88545b333f1eb603f83bbb309a0a033c2806edb4affe21efb44b6378"}
Jul 21 19:38:55.760131 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.760062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-549576786b-wcctq" event={"ID":"7e30b05e-c759-491a-a39f-152acafe84d1","Type":"ContainerStarted","Data":"8d0de4a4806ebe4b8cb0565730710776c7bf498f3184cd70de6e82f64ab53d16"}
Jul 21 19:38:55.777159 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.777119    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z72kl" podStartSLOduration=64.714983236 podStartE2EDuration="1m6.777107318s" totalImagesPullingTime="2.062124082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:55.776375395 +0000 UTC m=+103.489159969" watchObservedRunningTime="2026-07-21 19:38:55.777107318 +0000 UTC m=+103.489891890"
Jul 21 19:38:55.793808 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:55.793767    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-549576786b-wcctq" podStartSLOduration=33.793753297 podStartE2EDuration="33.793753297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:38:55.793148195 +0000 UTC m=+103.505932779" watchObservedRunningTime="2026-07-21 19:38:55.793753297 +0000 UTC m=+103.506537870"
Jul 21 19:38:56.147781 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:56.147667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:56.150232 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:56.150209    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:56.763554 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:56.763525    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:56.764783 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:56.764763    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-549576786b-wcctq"
Jul 21 19:38:57.178408 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.178336    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"]
Jul 21 19:38:57.215031 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.215004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"]
Jul 21 19:38:57.215186 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.215126    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.220064 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.220035    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 19:38:57.220304 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.220281    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 19:38:57.221164 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.221146    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 19:38:57.221281 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.221265    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 19:38:57.222539 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.222521    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 19:38:57.222684 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.222521    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 19:38:57.223895 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.223870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 19:38:57.307426 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.307583 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg826\" (UniqueName: \"kubernetes.io/projected/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-kube-api-access-cg826\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.307583 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.307666 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.307666 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.307771 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.307752    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.310974 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.310951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:57.408553 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.408738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.408738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.408738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg826\" (UniqueName: \"kubernetes.io/projected/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-kube-api-access-cg826\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.408738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.409041 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.408747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.409504 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.409476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.411151 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.411124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-ca\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.411371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.411353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.411466 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.411443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.411524 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.411510    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.421113 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.421083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:57.430222 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.430173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg826\" (UniqueName: \"kubernetes.io/projected/dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b-kube-api-access-cg826\") pod \"cluster-proxy-proxy-agent-77b796fd6b-6qkft\" (UID: \"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.527056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.527021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:57.533493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.533473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"
Jul 21 19:38:57.669751 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.669712    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft"]
Jul 21 19:38:57.672060 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:38:57.672027    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd4d35c8_c6d5_425b_8594_7ab6a8ca8c9b.slice/crio-e6bc130fb4702f4a8e3a0592ea3d08dd31f7be685314f1e80a6c8732c6e745ce WatchSource:0}: Error finding container e6bc130fb4702f4a8e3a0592ea3d08dd31f7be685314f1e80a6c8732c6e745ce: Status 404 returned error can't find the container with id e6bc130fb4702f4a8e3a0592ea3d08dd31f7be685314f1e80a6c8732c6e745ce
Jul 21 19:38:57.674099 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.674081    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-27rts"
Jul 21 19:38:57.768292 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.768253    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft" event={"ID":"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b","Type":"ContainerStarted","Data":"e6bc130fb4702f4a8e3a0592ea3d08dd31f7be685314f1e80a6c8732c6e745ce"}
Jul 21 19:38:57.858374 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.858339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:57.986760 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:57.986710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:58.123750 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:58.123651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:58.410982 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:58.410889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:38:59.944444 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:38:59.944382    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:00.045835 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:00.045741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:02.788561 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:02.788527    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft" event={"ID":"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b","Type":"ContainerStarted","Data":"0517c788dc3a49555e145eabfd6a8839899c4c794f81835c9fe5f1258f24e6bd"}
Jul 21 19:39:02.789075 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:02.788577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft" event={"ID":"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b","Type":"ContainerStarted","Data":"7059d5768419fa954818eb261ff2d492b030080faf683053ecdbe900841ac39b"}
Jul 21 19:39:02.789075 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:02.788595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft" event={"ID":"dd4d35c8-c6d5-425b-8594-7ab6a8ca8c9b","Type":"ContainerStarted","Data":"f8ac1700bada067699bd4a7411eda5fb53aba9f6376e10067a90aa8a4f2e11a5"}
Jul 21 19:39:02.807222 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:02.807173    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77b796fd6b-6qkft" podStartSLOduration=1.716215566 podStartE2EDuration="5.807156978s" totalImagesPullingTime="4.090941412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:02.805782699 +0000 UTC m=+110.518567271" watchObservedRunningTime="2026-07-21 19:39:02.807156978 +0000 UTC m=+110.519941550"
Jul 21 19:39:03.392864 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.392823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:03.456536 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.456497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:39:03.458860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.458833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a50bd7c-e332-4367-ae6b-4e52d9feb79a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqkvv\" (UID: \"0a50bd7c-e332-4367-ae6b-4e52d9feb79a\") " pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:39:03.555475 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.555428    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:03.701036 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.700933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqkvv"
Jul 21 19:39:03.832435 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:03.832404    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqkvv"]
Jul 21 19:39:03.835679 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:39:03.835650    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a50bd7c_e332_4367_ae6b_4e52d9feb79a.slice/crio-f5bbfdd224faed32b5fdd9ea53903ee55be225e0b4def6079888bcaed72180a1 WatchSource:0}: Error finding container f5bbfdd224faed32b5fdd9ea53903ee55be225e0b4def6079888bcaed72180a1: Status 404 returned error can't find the container with id f5bbfdd224faed32b5fdd9ea53903ee55be225e0b4def6079888bcaed72180a1
Jul 21 19:39:04.127830 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:04.127784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:04.221561 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:04.221516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:04.387372 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:04.387284    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:04.797147 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:04.797107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqkvv" event={"ID":"0a50bd7c-e332-4367-ae6b-4e52d9feb79a","Type":"ContainerStarted","Data":"f5bbfdd224faed32b5fdd9ea53903ee55be225e0b4def6079888bcaed72180a1"}
Jul 21 19:39:05.766476 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:05.766449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z72kl"
Jul 21 19:39:07.393348 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:07.393309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:07.456452 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:07.456394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:08.813586 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:08.813545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqkvv" event={"ID":"0a50bd7c-e332-4367-ae6b-4e52d9feb79a","Type":"ContainerStarted","Data":"d0292f31166415db7b6b8abd1aca396422115e62fd5d065e3d737e44fb2c19b5"}
Jul 21 19:39:10.393482 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:10.393445    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:11.577931 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:11.577884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:11.677445 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:11.677361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.269571 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.269530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.427859 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.427767    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.528372 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.528337    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mr59v"]
Jul 21 19:39:12.531730 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.531697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.535361 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.535326    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.536283 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.536262    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 19:39:12.536632 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.536607    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 19:39:12.536869 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.536850    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6t7pw\""
Jul 21 19:39:12.537812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.537623    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 19:39:12.537812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.537633    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 19:39:12.537812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.537682    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 19:39:12.537812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.537761    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 19:39:12.631357 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.631233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.634457 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-root\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634457 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wv6r\" (UniqueName: \"kubernetes.io/projected/47961dc6-2f66-4bc8-89b9-007a34b58ce2-kube-api-access-6wv6r\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-textfile\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-metrics-client-ca\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-wtmp\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.634860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.634777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-sys\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.729098 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.729063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.736115 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-sys\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-sys\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736333 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-root\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736333 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736446 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wv6r\" (UniqueName: \"kubernetes.io/projected/47961dc6-2f66-4bc8-89b9-007a34b58ce2-kube-api-access-6wv6r\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736446 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-textfile\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736446 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736368    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-root\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736446 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-metrics-client-ca\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736446 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-wtmp\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736738 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-wtmp\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.736862 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.736732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-textfile\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.738706 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.738664    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 19:39:12.738706 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.738674    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 19:39:12.738895 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.738742    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 19:39:12.739099 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.739082    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 19:39:12.744905 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.744739    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 19:39:12.747343 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:39:12.746577    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 19:39:12.747343 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:39:12.746648    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls podName:47961dc6-2f66-4bc8-89b9-007a34b58ce2 nodeName:}" failed. No retries permitted until 2026-07-21 19:39:13.246627869 +0000 UTC m=+120.959412441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls") pod "node-exporter-mr59v" (UID: "47961dc6-2f66-4bc8-89b9-007a34b58ce2") : secret "node-exporter-tls" not found
Jul 21 19:39:12.747578 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.747551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.747851 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.747793    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47961dc6-2f66-4bc8-89b9-007a34b58ce2-metrics-client-ca\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.750636 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.750580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.757044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.757020    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 19:39:12.766970 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.766940    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wv6r\" (UniqueName: \"kubernetes.io/projected/47961dc6-2f66-4bc8-89b9-007a34b58ce2-kube-api-access-6wv6r\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:12.831869 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.831827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqkvv" event={"ID":"0a50bd7c-e332-4367-ae6b-4e52d9feb79a","Type":"ContainerStarted","Data":"d52a05ffcd46ddd6d9ff2f587c0e3f433235ce32a299ea944ace134dcf0d385a"}
Jul 21 19:39:12.835477 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.835432    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:12.941546 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:12.941512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:13.043248 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.043124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:13.102257 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.102218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:13.342480 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.342393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:13.344845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.344822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/47961dc6-2f66-4bc8-89b9-007a34b58ce2-node-exporter-tls\") pod \"node-exporter-mr59v\" (UID: \"47961dc6-2f66-4bc8-89b9-007a34b58ce2\") " pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:13.374189 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.374149    2573 patch_prober.go:28] interesting pod/image-registry-c5449568b-qz4qf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 19:39:13.374344 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.374217    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 19:39:13.446077 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.446047    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6t7pw\""
Jul 21 19:39:13.454003 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.453978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr59v"
Jul 21 19:39:13.467786 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:39:13.467755    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47961dc6_2f66_4bc8_89b9_007a34b58ce2.slice/crio-2211e9ba775e92dca4681e429d38d7f1cc15a263bee365d7c688466e87b2cb2a WatchSource:0}: Error finding container 2211e9ba775e92dca4681e429d38d7f1cc15a263bee365d7c688466e87b2cb2a: Status 404 returned error can't find the container with id 2211e9ba775e92dca4681e429d38d7f1cc15a263bee365d7c688466e87b2cb2a
Jul 21 19:39:13.522759 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.522699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:13.623457 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.623366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:13.838533 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.838493    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr59v" event={"ID":"47961dc6-2f66-4bc8-89b9-007a34b58ce2","Type":"ContainerStarted","Data":"2211e9ba775e92dca4681e429d38d7f1cc15a263bee365d7c688466e87b2cb2a"}
Jul 21 19:39:13.840945 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:13.840920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:14.171247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:14.171198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:14.756117 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:14.756087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:39:15.354022 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.353983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:15.452178 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.452138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:15.516758 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.516706    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"]
Jul 21 19:39:15.536500 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.536247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:15.544236 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.544205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"]
Jul 21 19:39:15.544375 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.544357    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.547625 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.547600    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6js8g\""
Jul 21 19:39:15.548687 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.548666    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 19:39:15.548825 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.548665    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 19:39:15.548825 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.548667    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 19:39:15.549116 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.549091    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 19:39:15.549664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.549449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 19:39:15.549664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.549504    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c8u5bnei811pn\""
Jul 21 19:39:15.636105 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.636018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:15.664314 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664447 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664447 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664447 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-grpc-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664447 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6825\" (UniqueName: \"kubernetes.io/projected/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-kube-api-access-z6825\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664607 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-metrics-client-ca\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.664679 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.664650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.765735 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.765902 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.765902 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766008 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-grpc-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766008 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766008 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.765986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6825\" (UniqueName: \"kubernetes.io/projected/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-kube-api-access-z6825\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766173 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.766039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-metrics-client-ca\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766173 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.766119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.766920 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.766891    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-metrics-client-ca\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.769053 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.768798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.769053 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.768967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.769233 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.769135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.769233 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.769200    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.770245 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.770194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.770353 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.770331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-secret-grpc-tls\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.774898 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.774871    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6825\" (UniqueName: \"kubernetes.io/projected/5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1-kube-api-access-z6825\") pod \"thanos-querier-7499f8dfb4-ft8zq\" (UID: \"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1\") " pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:15.858173 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:15.858139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:16.000806 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.000769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:16.107817 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.107776    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"]
Jul 21 19:39:16.112167 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:39:16.112134    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aedb61e_36b8_49fe_8ff6_8c99ce6b0ae1.slice/crio-2d804d8eff390b1f398a0086c758277f35cfd54e5c63c163f13cf2290dc887d4 WatchSource:0}: Error finding container 2d804d8eff390b1f398a0086c758277f35cfd54e5c63c163f13cf2290dc887d4: Status 404 returned error can't find the container with id 2d804d8eff390b1f398a0086c758277f35cfd54e5c63c163f13cf2290dc887d4
Jul 21 19:39:16.851395 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.851357    2573 generic.go:356] "Generic (PLEG): container finished" podID="47961dc6-2f66-4bc8-89b9-007a34b58ce2" containerID="52d5b956925f4add14a9e5876408bb1ed1e9ab36260e2cd70129dbac99aa15ed" exitCode=0
Jul 21 19:39:16.851860 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.851453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr59v" event={"ID":"47961dc6-2f66-4bc8-89b9-007a34b58ce2","Type":"ContainerDied","Data":"52d5b956925f4add14a9e5876408bb1ed1e9ab36260e2cd70129dbac99aa15ed"}
Jul 21 19:39:16.854030 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.854001    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqkvv" event={"ID":"0a50bd7c-e332-4367-ae6b-4e52d9feb79a","Type":"ContainerStarted","Data":"bebff24d7c305a63d4f28373efb730e12dd36ddfd17b158f42886ec875d85754"}
Jul 21 19:39:16.855554 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.855529    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"2d804d8eff390b1f398a0086c758277f35cfd54e5c63c163f13cf2290dc887d4"}
Jul 21 19:39:16.887649 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:16.887588    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rqkvv" podStartSLOduration=33.871213605 podStartE2EDuration="45.887566591s" totalImagesPullingTime="12.016352986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:38:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:16.886774833 +0000 UTC m=+124.599559434" watchObservedRunningTime="2026-07-21 19:39:16.887566591 +0000 UTC m=+124.600351165"
Jul 21 19:39:17.316313 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.316278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:17.327678 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.327647    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"]
Jul 21 19:39:17.330792 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.330771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.333725 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.333700    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 19:39:17.333800 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.333736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7ls2z\""
Jul 21 19:39:17.355828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.355791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"]
Jul 21 19:39:17.379012 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.378973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84d43cad-9f2f-4115-80b3-a44bf347b1c3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.379164 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.379027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9x76\" (UniqueName: \"kubernetes.io/projected/84d43cad-9f2f-4115-80b3-a44bf347b1c3-kube-api-access-k9x76\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.428771 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.428706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:17.480086 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.480054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84d43cad-9f2f-4115-80b3-a44bf347b1c3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.480254 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.480102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9x76\" (UniqueName: \"kubernetes.io/projected/84d43cad-9f2f-4115-80b3-a44bf347b1c3-kube-api-access-k9x76\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.482875 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.482846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84d43cad-9f2f-4115-80b3-a44bf347b1c3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.490214 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.490190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9x76\" (UniqueName: \"kubernetes.io/projected/84d43cad-9f2f-4115-80b3-a44bf347b1c3-kube-api-access-k9x76\") pod \"monitoring-plugin-7b7b7bc8bf-dx5xd\" (UID: \"84d43cad-9f2f-4115-80b3-a44bf347b1c3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.498662 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.498622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:17.639701 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.639626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:17.789795 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.789771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"]
Jul 21 19:39:17.791912 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:39:17.791884    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d43cad_9f2f_4115_80b3_a44bf347b1c3.slice/crio-532fa47a12ea2cb8d10e32009faa6885ba9c36397b3889ed5d97a4640783467e WatchSource:0}: Error finding container 532fa47a12ea2cb8d10e32009faa6885ba9c36397b3889ed5d97a4640783467e: Status 404 returned error can't find the container with id 532fa47a12ea2cb8d10e32009faa6885ba9c36397b3889ed5d97a4640783467e
Jul 21 19:39:17.861000 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.860957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd" event={"ID":"84d43cad-9f2f-4115-80b3-a44bf347b1c3","Type":"ContainerStarted","Data":"532fa47a12ea2cb8d10e32009faa6885ba9c36397b3889ed5d97a4640783467e"}
Jul 21 19:39:17.863333 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.863302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr59v" event={"ID":"47961dc6-2f66-4bc8-89b9-007a34b58ce2","Type":"ContainerStarted","Data":"98efef1eee072faf687a6d7585b217cfe0033f1a4bc5542a9f76b965bf8fd726"}
Jul 21 19:39:17.863462 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.863362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr59v" event={"ID":"47961dc6-2f66-4bc8-89b9-007a34b58ce2","Type":"ContainerStarted","Data":"f1d489bf919d8c1c2a95ed527dc5301b2e97caece2aa5d847402b02e6ffd39ce"}
Jul 21 19:39:17.884769 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:17.884687    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mr59v" podStartSLOduration=3.315576337 podStartE2EDuration="5.884585586s" totalImagesPullingTime="2.495945056s" totalInitContainerRuntime="73.064193ms" isStatefulPod=true podCreationTimestamp="2026-07-21 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:17.884078637 +0000 UTC m=+125.596863209" watchObservedRunningTime="2026-07-21 19:39:17.884585586 +0000 UTC m=+125.597370160"
Jul 21 19:39:18.686830 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:18.686786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:18.868846 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:18.868751    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"fb9f3e1be2e784ee05326d0d97a940fa0a996ee47e828826c217af425ccb1eea"}
Jul 21 19:39:18.869314 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:18.868864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"2d7895710ef2a0f85fae81cec1c9cdf3ce5f6198a1868e0cd0ab4f0ebbcd9b4a"}
Jul 21 19:39:18.869314 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:18.868911    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"a40f605314c78fccee0cfae8248acbbbd16a07f01d4af90c51937b513d7616de"}
Jul 21 19:39:19.072410 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.072370    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:39:19.188280 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.188197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:19.270653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.270606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:19.337418 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.337371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:19.438654 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.438541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:19.873820 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.873789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd" event={"ID":"84d43cad-9f2f-4115-80b3-a44bf347b1c3","Type":"ContainerStarted","Data":"87b66ddb68f4ca63dc8b94e7410bf1e8e45d6de976e67002044d21f09756eb2b"}
Jul 21 19:39:19.874185 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.873949    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:19.878819 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.878798    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd"
Jul 21 19:39:19.890263 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:19.890221    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dx5xd" podStartSLOduration=1.019526961 podStartE2EDuration="2.890207392s" totalImagesPullingTime="1.870680431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:19.889872229 +0000 UTC m=+127.602656802" watchObservedRunningTime="2026-07-21 19:39:19.890207392 +0000 UTC m=+127.602991943"
Jul 21 19:39:20.880329 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:20.880292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"69b3ff022d625c3b6df8ecc4949be510d5ef874bd0f578d5d08154eca58ab663"}
Jul 21 19:39:20.880845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:20.880371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"571c20569b7f233648eec793a85063d6fcc8e35d1c7a50f46d8c048ec8e10bd5"}
Jul 21 19:39:20.880845 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:20.880409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" event={"ID":"5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1","Type":"ContainerStarted","Data":"ffe4281b97d1b294ca26d0540e906e46a68daf63bca21d0ab56d2125fb6eff55"}
Jul 21 19:39:20.905591 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:20.905537    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq" podStartSLOduration=2.030744834 podStartE2EDuration="5.905522011s" totalImagesPullingTime="3.874777177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:39:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:20.905123807 +0000 UTC m=+128.617908380" watchObservedRunningTime="2026-07-21 19:39:20.905522011 +0000 UTC m=+128.618306581"
Jul 21 19:39:21.884059 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:21.884023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:22.071302 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:22.071267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:22.179086 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:22.178998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:22.232688 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:22.232656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:23.187662 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:23.187629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:23.251162 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:23.251119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:23.899825 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:23.899795    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:24.310143 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:24.310113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:24.411478 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:24.411440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:25.548439 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:25.548410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:39:25.550623 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:25.550602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5074fdf4-ca29-4d4c-b09a-9b0c79a485f3-metrics-certs\") pod \"network-metrics-daemon-rhb84\" (UID: \"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3\") " pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:39:25.833076 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:25.832983    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tcjpf\""
Jul 21 19:39:25.840286 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:25.840257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhb84"
Jul 21 19:39:25.968359 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:25.968328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhb84"]
Jul 21 19:39:25.971652 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:39:25.971622    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5074fdf4_ca29_4d4c_b09a_9b0c79a485f3.slice/crio-ffd5be70461bc9fedfdda26089321c058657ca20ff87142c058aff0d2e460366 WatchSource:0}: Error finding container ffd5be70461bc9fedfdda26089321c058657ca20ff87142c058aff0d2e460366: Status 404 returned error can't find the container with id ffd5be70461bc9fedfdda26089321c058657ca20ff87142c058aff0d2e460366
Jul 21 19:39:26.261035 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:26.261009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:26.361354 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:26.361317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:26.902844 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:26.902802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhb84" event={"ID":"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3","Type":"ContainerStarted","Data":"ffd5be70461bc9fedfdda26089321c058657ca20ff87142c058aff0d2e460366"}
Jul 21 19:39:27.894474 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:27.894447    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7499f8dfb4-ft8zq"
Jul 21 19:39:27.908592 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:27.908563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhb84" event={"ID":"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3","Type":"ContainerStarted","Data":"2d8c9648829526d1c7eeacbc82743c1d55c4d3b82eb4dd63f0cfab0f8c8aecd2"}
Jul 21 19:39:27.909020 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:27.908611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhb84" event={"ID":"5074fdf4-ca29-4d4c-b09a-9b0c79a485f3","Type":"ContainerStarted","Data":"b54b46bd0bc958f3b1401ea6154c77b835c9ca497ee24d0c664f89e7e83468be"}
Jul 21 19:39:27.936568 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:27.936515    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rhb84" podStartSLOduration=133.004560799 podStartE2EDuration="2m13.936499312s" totalImagesPullingTime="931.938513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:39:27.936010621 +0000 UTC m=+135.648795222" watchObservedRunningTime="2026-07-21 19:39:27.936499312 +0000 UTC m=+135.649283884"
Jul 21 19:39:28.044014 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:28.043947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:28.144351 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:28.144320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:29.295848 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:29.295811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:29.402015 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:29.401972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:29.941611 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:29.941569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:30.043940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:30.043905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:32.261902 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:32.261854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:32.361994 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:32.361960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:33.435706 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:33.435670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:33.493565 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:33.493531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:37.434150 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:37.434097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:37.533449 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:37.533408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:37.634130 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:37.634096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:37.691734 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:37.691615    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:44.096114 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.096052    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry" containerID="cri-o://fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957" gracePeriod=30
Jul 21 19:39:44.750621 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.750592    2573 patch_prober.go:28] interesting pod/image-registry-c5449568b-qz4qf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body=
Jul 21 19:39:44.750749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.750675    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused"
Jul 21 19:39:44.897266 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.897235    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:39:44.951996 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.951964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:44.965985 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.965954    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerID="fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957" exitCode=0
Jul 21 19:39:44.966154 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.966000    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5449568b-qz4qf"
Jul 21 19:39:44.966154 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.965997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" event={"ID":"9a6f2a2d-0dd0-49f5-8064-89880fece95e","Type":"ContainerDied","Data":"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"}
Jul 21 19:39:44.966154 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.966059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5449568b-qz4qf" event={"ID":"9a6f2a2d-0dd0-49f5-8064-89880fece95e","Type":"ContainerDied","Data":"03fc0704a35bbcf23ef0a61491d883c96501d97c3c48f983339912481e2909a1"}
Jul 21 19:39:44.966154 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.966089    2573 scope.go:117] "RemoveContainer" containerID="fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"
Jul 21 19:39:44.974088 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.974069    2573 scope.go:117] "RemoveContainer" containerID="fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"
Jul 21 19:39:44.974362 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:39:44.974342    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957\": container with ID starting with fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957 not found: ID does not exist" containerID="fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"
Jul 21 19:39:44.974406 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:44.974371    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957"} err="failed to get container status \"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957\": rpc error: code = NotFound desc = could not find container \"fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957\": container with ID starting with fc1a191bcc8046f7e0865b0239d3394a4a49c48c33ec0847030323692e856957 not found: ID does not exist"
Jul 21 19:39:45.014747 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014641    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mldxj\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.014747 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.014747 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014750    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.015038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014770    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.015038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014785    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.015038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014832    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.015038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014871    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.015038 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.014919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca\") pod \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\" (UID: \"9a6f2a2d-0dd0-49f5-8064-89880fece95e\") "
Jul 21 19:39:45.017114 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.015638    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 19:39:45.017114 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.016136    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 19:39:45.017857 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.017584    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj" (OuterVolumeSpecName: "kube-api-access-mldxj") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "kube-api-access-mldxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:39:45.021681 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.021647    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:39:45.022608 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.021881    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 19:39:45.022608 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.022043    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:39:45.022857 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.022810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:39:45.023318 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.022971    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 19:39:45.027382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.027356    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9a6f2a2d-0dd0-49f5-8064-89880fece95e" (UID: "9a6f2a2d-0dd0-49f5-8064-89880fece95e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 19:39:45.116179 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116149    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-trusted-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116179 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116174    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mldxj\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-kube-api-access-mldxj\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116179 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116183    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6f2a2d-0dd0-49f5-8064-89880fece95e-ca-trust-extracted\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116193    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-certificates\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116201    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-installation-pull-secrets\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116209    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-registry-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116219    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6f2a2d-0dd0-49f5-8064-89880fece95e-image-registry-private-configuration\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.116577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.116228    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6f2a2d-0dd0-49f5-8064-89880fece95e-bound-sa-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:39:45.288535 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.288503    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:39:45.296235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:45.296204    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c5449568b-qz4qf"]
Jul 21 19:39:46.414276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:46.414238    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" path="/var/lib/kubelet/pods/9a6f2a2d-0dd0-49f5-8064-89880fece95e/volumes"
Jul 21 19:39:59.940833 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:39:59.940785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:00.042639 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:00.042596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:07.057804 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:07.057691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:07.114020 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:07.113972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:28.599287 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:28.599247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:28.665529 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:28.665492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:40.489544 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:40.489500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:40.551132 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:40.551087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:42.401080 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:42.401048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:42.460597 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:42.460565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:45.070495 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:45.070461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:45.137160 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:45.137133    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:53.661862 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:53.661821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:53.763235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:53.763205    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:40:53.886873 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:40:53.886832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:11.226189 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:11.226157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:27.063707 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:27.063659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:27.165103 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:27.165062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:43.265372 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:43.265281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:43.363363 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:43.363334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:41:44.040370 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.040333    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"]
Jul 21 19:41:44.040613 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.040601    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry"
Jul 21 19:41:44.040664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.040614    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry"
Jul 21 19:41:44.040664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.040660    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6f2a2d-0dd0-49f5-8064-89880fece95e" containerName="registry"
Jul 21 19:41:44.043545 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.043528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.046391 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.046367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 19:41:44.046391 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.046385    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4kcvb\""
Jul 21 19:41:44.046581 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.046367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 19:41:44.055196 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.055173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"]
Jul 21 19:41:44.078255 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.078225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj84m\" (UniqueName: \"kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.078357 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.078276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.078357 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.078328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.178797 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.178758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.178900 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.178809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.178900 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.178859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj84m\" (UniqueName: \"kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.179119 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.179098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.179161 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.179126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.187599 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.187568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj84m\" (UniqueName: \"kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.352367 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.352281    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:41:44.478351 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:44.478280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"]
Jul 21 19:41:44.481121 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:41:44.481097    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0b2eb4_97d9_4099_892c_ffcbf7009851.slice/crio-49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed WatchSource:0}: Error finding container 49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed: Status 404 returned error can't find the container with id 49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed
Jul 21 19:41:45.384938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:45.384904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz" event={"ID":"7a0b2eb4-97d9-4099-892c-ffcbf7009851","Type":"ContainerStarted","Data":"49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed"}
Jul 21 19:41:52.414259 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:52.414177    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerID="5a9041935ca3d5a695924775f4dc93a52182d407ec5bb2f181f3ff3d77258aed" exitCode=0
Jul 21 19:41:52.414710 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:52.414687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz" event={"ID":"7a0b2eb4-97d9-4099-892c-ffcbf7009851","Type":"ContainerDied","Data":"5a9041935ca3d5a695924775f4dc93a52182d407ec5bb2f181f3ff3d77258aed"}
Jul 21 19:41:55.430084 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:55.430048    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerID="5e7eea0d67a2771a9a4c247a97d77a49ea4bbf01ba1710fa554cb82ca8fbf145" exitCode=0
Jul 21 19:41:55.430461 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:41:55.430108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz" event={"ID":"7a0b2eb4-97d9-4099-892c-ffcbf7009851","Type":"ContainerDied","Data":"5e7eea0d67a2771a9a4c247a97d77a49ea4bbf01ba1710fa554cb82ca8fbf145"}
Jul 21 19:42:04.469833 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:04.469798    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerID="24f6dfde6415ffc56109f455f5a40ee3b17e0afce5e7aeb0f8c0daa4e53e388f" exitCode=0
Jul 21 19:42:04.470282 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:04.469887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz" event={"ID":"7a0b2eb4-97d9-4099-892c-ffcbf7009851","Type":"ContainerDied","Data":"24f6dfde6415ffc56109f455f5a40ee3b17e0afce5e7aeb0f8c0daa4e53e388f"}
Jul 21 19:42:05.595606 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.595579    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:42:05.752062 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.751961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle\") pod \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") "
Jul 21 19:42:05.752062 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.752045    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj84m\" (UniqueName: \"kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m\") pod \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") "
Jul 21 19:42:05.752062 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.752069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util\") pod \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\" (UID: \"7a0b2eb4-97d9-4099-892c-ffcbf7009851\") "
Jul 21 19:42:05.752673 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.752643    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle" (OuterVolumeSpecName: "bundle") pod "7a0b2eb4-97d9-4099-892c-ffcbf7009851" (UID: "7a0b2eb4-97d9-4099-892c-ffcbf7009851"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 19:42:05.754242 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.754220    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m" (OuterVolumeSpecName: "kube-api-access-cj84m") pod "7a0b2eb4-97d9-4099-892c-ffcbf7009851" (UID: "7a0b2eb4-97d9-4099-892c-ffcbf7009851"). InnerVolumeSpecName "kube-api-access-cj84m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:42:05.757306 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.757282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util" (OuterVolumeSpecName: "util") pod "7a0b2eb4-97d9-4099-892c-ffcbf7009851" (UID: "7a0b2eb4-97d9-4099-892c-ffcbf7009851"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 19:42:05.853435 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.853395    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-util\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:05.853435 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.853423    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0b2eb4-97d9-4099-892c-ffcbf7009851-bundle\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:05.853435 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:05.853435    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj84m\" (UniqueName: \"kubernetes.io/projected/7a0b2eb4-97d9-4099-892c-ffcbf7009851-kube-api-access-cj84m\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:06.479141 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:06.479115    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz"
Jul 21 19:42:06.479291 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:06.479109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ct4mz" event={"ID":"7a0b2eb4-97d9-4099-892c-ffcbf7009851","Type":"ContainerDied","Data":"49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed"}
Jul 21 19:42:06.479291 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:06.479232    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49a16f7e5ba80ed71c804d8f2fa0103f279b616de76177a71c296eae538e0aed"
Jul 21 19:42:10.419269 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:10.419233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:11.753920 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:11.753874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:12.495966 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.495933    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"]
Jul 21 19:42:12.496305 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496283    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="util"
Jul 21 19:42:12.496305 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496301    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="util"
Jul 21 19:42:12.496305 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496309    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="pull"
Jul 21 19:42:12.496493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496315    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="pull"
Jul 21 19:42:12.496493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496323    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="extract"
Jul 21 19:42:12.496493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496330    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="extract"
Jul 21 19:42:12.496493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.496389    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0b2eb4-97d9-4099-892c-ffcbf7009851" containerName="extract"
Jul 21 19:42:12.499781 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.499763    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.502595 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.502575    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 19:42:12.502754 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.502737    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 19:42:12.502841 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.502737    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-szsjl\""
Jul 21 19:42:12.520282 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.520255    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"]
Jul 21 19:42:12.603643 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.603609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.603643 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.603645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllp8\" (UniqueName: \"kubernetes.io/projected/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-kube-api-access-wllp8\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.704218 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.704191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wllp8\" (UniqueName: \"kubernetes.io/projected/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-kube-api-access-wllp8\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.704365 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.704262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.704620 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.704605    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.717975 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.717954    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 19:42:12.728574 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.728557    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 19:42:12.738525 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.738494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllp8\" (UniqueName: \"kubernetes.io/projected/e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856-kube-api-access-wllp8\") pod \"cert-manager-operator-controller-manager-55c444bf86-j24k2\" (UID: \"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.811423 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.811349    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-szsjl\""
Jul 21 19:42:12.818974 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.818950    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"
Jul 21 19:42:12.949974 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:12.949953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2"]
Jul 21 19:42:12.952239 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:42:12.952214    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e86d2a_0abd_43a7_b6e2_ccd6d0aea856.slice/crio-d8235ac64eb771abd7be2ad14de64eade84ba0431df2cded57c20ab08c0b89c4 WatchSource:0}: Error finding container d8235ac64eb771abd7be2ad14de64eade84ba0431df2cded57c20ab08c0b89c4: Status 404 returned error can't find the container with id d8235ac64eb771abd7be2ad14de64eade84ba0431df2cded57c20ab08c0b89c4
Jul 21 19:42:13.503883 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:13.503848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2" event={"ID":"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856","Type":"ContainerStarted","Data":"d8235ac64eb771abd7be2ad14de64eade84ba0431df2cded57c20ab08c0b89c4"}
Jul 21 19:42:14.127870 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:14.127842    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 19:42:14.189139 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:14.189089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:14.290580 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:14.290533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:15.512779 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:15.512738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2" event={"ID":"e6e86d2a-0abd-43a7-b6e2-ccd6d0aea856","Type":"ContainerStarted","Data":"3daa152121bddf62a98eaa4b9e5c3fecd9bcd755a3a9a27b66aff1b3bf5913eb"}
Jul 21 19:42:15.559884 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:15.559836    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j24k2" podStartSLOduration=1.953765759 podStartE2EDuration="3.559818577s" totalImagesPullingTime="1.606052818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:42:15.557786421 +0000 UTC m=+303.270571015" watchObservedRunningTime="2026-07-21 19:42:15.559818577 +0000 UTC m=+303.272603150"
Jul 21 19:42:16.018605 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:16.018571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:16.113832 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:16.113796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:16.381667 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:16.381584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:16.494370 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:16.494335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:18.783558 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:18.783527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:18.994587 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:18.994550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:21.114966 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:21.114929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:21.234905 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:21.234867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:23.921383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:23.921345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:24.020861 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:24.020822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:26.304114 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:26.304080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:28.863303 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:28.863271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:29.728483 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.728450    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlr8f"]
Jul 21 19:42:29.730680 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.730661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.733396 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.733370    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 19:42:29.734490 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.734464    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 19:42:29.734608 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.734468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6hzr8\""
Jul 21 19:42:29.740554 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.740530    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlr8f"]
Jul 21 19:42:29.835952 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.835910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.836124 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.836020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x4lq\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-kube-api-access-6x4lq\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.936676 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.936640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4lq\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-kube-api-access-6x4lq\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.936676 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.936680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.945081 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.945051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:29.945221 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:29.945203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x4lq\" (UniqueName: \"kubernetes.io/projected/ee8d3d74-b60e-4622-9729-118b297b4703-kube-api-access-6x4lq\") pod \"cert-manager-55b4d954d5-hlr8f\" (UID: \"ee8d3d74-b60e-4622-9729-118b297b4703\") " pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:30.040157 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:30.040055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hlr8f"
Jul 21 19:42:30.178174 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:30.178143    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlr8f"]
Jul 21 19:42:30.181321 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:42:30.181295    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee8d3d74_b60e_4622_9729_118b297b4703.slice/crio-5a5ec07cffce19357c5458d277f03922eb0b753f6e08ba7b01e49a66e0626b3e WatchSource:0}: Error finding container 5a5ec07cffce19357c5458d277f03922eb0b753f6e08ba7b01e49a66e0626b3e: Status 404 returned error can't find the container with id 5a5ec07cffce19357c5458d277f03922eb0b753f6e08ba7b01e49a66e0626b3e
Jul 21 19:42:30.183326 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:30.183310    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 19:42:30.569152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:30.569113    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hlr8f" event={"ID":"ee8d3d74-b60e-4622-9729-118b297b4703","Type":"ContainerStarted","Data":"5a5ec07cffce19357c5458d277f03922eb0b753f6e08ba7b01e49a66e0626b3e"}
Jul 21 19:42:33.584140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:33.584100    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hlr8f" event={"ID":"ee8d3d74-b60e-4622-9729-118b297b4703","Type":"ContainerStarted","Data":"b387adc7bef00b4965a4fc6ceaf7efd9d7f6e0ab799b183efef1de4b6dfb0391"}
Jul 21 19:42:33.602114 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:33.602055    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hlr8f" podStartSLOduration=1.769814583 podStartE2EDuration="4.602038015s" totalImagesPullingTime="2.832223432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:42:33.601989441 +0000 UTC m=+321.314774019" watchObservedRunningTime="2026-07-21 19:42:33.602038015 +0000 UTC m=+321.314822588"
Jul 21 19:42:38.825765 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:38.825728    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:38.920371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:38.920334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:44.604262 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:44.604226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:45.950437 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:45.950402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:46.419888 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.419858    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"]
Jul 21 19:42:46.422207 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.422188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.424976 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.424955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4kcvb\""
Jul 21 19:42:46.425575 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.425562    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 19:42:46.426069 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.426047    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 19:42:46.432659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.432638    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"]
Jul 21 19:42:46.468834 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.468809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.469064 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.469042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.469152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.469137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzlxr\" (UniqueName: \"kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.570263 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.570226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.570429 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.570296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlxr\" (UniqueName: \"kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.570429 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.570344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.570749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.570699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.570793 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.570745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.579423 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.579396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzlxr\" (UniqueName: \"kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.731263 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.731236    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:46.856307 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.856172    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"]
Jul 21 19:42:46.858957 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:42:46.858922    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250b4ae8_879d_43c0_ba7d_ca4e61e62d42.slice/crio-4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37 WatchSource:0}: Error finding container 4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37: Status 404 returned error can't find the container with id 4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37
Jul 21 19:42:46.870088 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:46.870062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:47.641877 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:47.641840    2573 generic.go:356] "Generic (PLEG): container finished" podID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerID="28e550c0d87c080096167cb91881d6945ff7b50d5db1a4b205a0aeec05a4f48e" exitCode=0
Jul 21 19:42:47.642271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:47.641923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn" event={"ID":"250b4ae8-879d-43c0-ba7d-ca4e61e62d42","Type":"ContainerDied","Data":"28e550c0d87c080096167cb91881d6945ff7b50d5db1a4b205a0aeec05a4f48e"}
Jul 21 19:42:47.642271 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:47.641967    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn" event={"ID":"250b4ae8-879d-43c0-ba7d-ca4e61e62d42","Type":"ContainerStarted","Data":"4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37"}
Jul 21 19:42:48.647827 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:48.647799    2573 generic.go:356] "Generic (PLEG): container finished" podID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerID="9fb2a4c8f69a0602690258406b00973e71013ee06bb016a8f8b916ca45ff041b" exitCode=0
Jul 21 19:42:48.648277 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:48.647874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn" event={"ID":"250b4ae8-879d-43c0-ba7d-ca4e61e62d42","Type":"ContainerDied","Data":"9fb2a4c8f69a0602690258406b00973e71013ee06bb016a8f8b916ca45ff041b"}
Jul 21 19:42:49.653268 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:49.653231    2573 generic.go:356] "Generic (PLEG): container finished" podID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerID="f63a790a010eabbc762564fad106505aec18fdccd0bc84aef9487141a3b3e6ac" exitCode=0
Jul 21 19:42:49.653633 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:49.653278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn" event={"ID":"250b4ae8-879d-43c0-ba7d-ca4e61e62d42","Type":"ContainerDied","Data":"f63a790a010eabbc762564fad106505aec18fdccd0bc84aef9487141a3b3e6ac"}
Jul 21 19:42:50.782936 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.782909    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:50.901937 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.901899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util\") pod \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") "
Jul 21 19:42:50.902128 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.901969    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle\") pod \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") "
Jul 21 19:42:50.902128 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.901998    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzlxr\" (UniqueName: \"kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr\") pod \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\" (UID: \"250b4ae8-879d-43c0-ba7d-ca4e61e62d42\") "
Jul 21 19:42:50.902653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.902620    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle" (OuterVolumeSpecName: "bundle") pod "250b4ae8-879d-43c0-ba7d-ca4e61e62d42" (UID: "250b4ae8-879d-43c0-ba7d-ca4e61e62d42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 19:42:50.904051 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.904029    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr" (OuterVolumeSpecName: "kube-api-access-gzlxr") pod "250b4ae8-879d-43c0-ba7d-ca4e61e62d42" (UID: "250b4ae8-879d-43c0-ba7d-ca4e61e62d42"). InnerVolumeSpecName "kube-api-access-gzlxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:42:50.907395 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:50.907374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util" (OuterVolumeSpecName: "util") pod "250b4ae8-879d-43c0-ba7d-ca4e61e62d42" (UID: "250b4ae8-879d-43c0-ba7d-ca4e61e62d42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 19:42:51.003018 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.002981    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-bundle\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:51.003018 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.003013    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzlxr\" (UniqueName: \"kubernetes.io/projected/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-kube-api-access-gzlxr\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:51.003018 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.003023    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/250b4ae8-879d-43c0-ba7d-ca4e61e62d42-util\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:42:51.663211 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.663183    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn"
Jul 21 19:42:51.663211 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.663191    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95mgn" event={"ID":"250b4ae8-879d-43c0-ba7d-ca4e61e62d42","Type":"ContainerDied","Data":"4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37"}
Jul 21 19:42:51.663418 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:51.663241    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f12285065a83dcd551f930db037315dfd8b65c036c9a18ec570b3ee55f09d37"
Jul 21 19:42:55.198338 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.198307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:55.265518 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265480    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"]
Jul 21 19:42:55.265842 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265825    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="extract"
Jul 21 19:42:55.265923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265844    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="extract"
Jul 21 19:42:55.265923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265862    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="util"
Jul 21 19:42:55.265923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265872    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="util"
Jul 21 19:42:55.265923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265885    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="pull"
Jul 21 19:42:55.265923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265895    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="pull"
Jul 21 19:42:55.266158 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.265999    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="250b4ae8-879d-43c0-ba7d-ca4e61e62d42" containerName="extract"
Jul 21 19:42:55.269630 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.269611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.272575 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.272547    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 19:42:55.273650 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.273633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 19:42:55.273746 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.273710    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 19:42:55.273746 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.273733    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qlwsm\""
Jul 21 19:42:55.273870 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.273744    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 19:42:55.273910 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.273878    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 19:42:55.282757 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.282707    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"]
Jul 21 19:42:55.300125 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.300095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:55.340842 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.340809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.341003 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.340852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5wwl\" (UniqueName: \"kubernetes.io/projected/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-kube-api-access-c5wwl\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.341003 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.340899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.341003 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.340922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.441952 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.441916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.442135 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.441958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.442135 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.441999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.442135 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.442031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5wwl\" (UniqueName: \"kubernetes.io/projected/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-kube-api-access-c5wwl\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.442779 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.442755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-manager-config\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.444386 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.444362    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.444494 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.444425    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-metrics-cert\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.451408 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.451354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5wwl\" (UniqueName: \"kubernetes.io/projected/8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f-kube-api-access-c5wwl\") pod \"lws-controller-manager-bc6b5d4fd-96z6c\" (UID: \"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f\") " pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.579272 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.579221    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:55.729658 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:55.729638    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"]
Jul 21 19:42:55.731621 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:42:55.731600    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef170b6_8902_4b0a_bbc7_0efb7b0d4a1f.slice/crio-2e935af39534e87ea2b793f9c4a320b839630b7c1b08380450ba5570ca751ce8 WatchSource:0}: Error finding container 2e935af39534e87ea2b793f9c4a320b839630b7c1b08380450ba5570ca751ce8: Status 404 returned error can't find the container with id 2e935af39534e87ea2b793f9c4a320b839630b7c1b08380450ba5570ca751ce8
Jul 21 19:42:56.684366 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:56.684325    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c" event={"ID":"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f","Type":"ContainerStarted","Data":"2e935af39534e87ea2b793f9c4a320b839630b7c1b08380450ba5570ca751ce8"}
Jul 21 19:42:58.066480 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:58.066446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:58.167956 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:58.167923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:42:58.694215 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:58.694176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c" event={"ID":"8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f","Type":"ContainerStarted","Data":"290419e99f962f19345c1a28c41aa6ff6ac137879e268c18a97ab29c57d7d9b2"}
Jul 21 19:42:58.694401 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:58.694239    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:42:58.721301 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:42:58.721254    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c" podStartSLOduration=1.441994061 podStartE2EDuration="3.721238198s" totalImagesPullingTime="2.279244137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:42:58.720074519 +0000 UTC m=+346.432859093" watchObservedRunningTime="2026-07-21 19:42:58.721238198 +0000 UTC m=+346.434022770"
Jul 21 19:43:02.147748 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:02.147693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:02.368966 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:02.368923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:02.787313 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:02.787274    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.036342 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.036308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.149135 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.149046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.210230 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.210196    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"]
Jul 21 19:43:03.213749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.213709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.216229 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.216200    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 19:43:03.216354 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.216316    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-brd8z\""
Jul 21 19:43:03.217247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.217228    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 19:43:03.217491 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.217476    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 19:43:03.217533 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.217502    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 19:43:03.235117 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.235086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"]
Jul 21 19:43:03.304187 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.304148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.304383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.304197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.304383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.304228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.304383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.304257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97tht\" (UniqueName: \"kubernetes.io/projected/36069701-b15e-4a9b-a748-4a65b8f36272-kube-api-access-97tht\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.304383 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.304287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.337623 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.337576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.405044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.404955    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.405044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.404999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.405044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.405036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97tht\" (UniqueName: \"kubernetes.io/projected/36069701-b15e-4a9b-a748-4a65b8f36272-kube-api-access-97tht\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.405312 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.405069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.405312 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.405148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.405530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.405508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-manifests\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.407420 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.407398    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36069701-b15e-4a9b-a748-4a65b8f36272-tmp\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.407569 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.407551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.407889 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.407874    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36069701-b15e-4a9b-a748-4a65b8f36272-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.414104 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.414083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97tht\" (UniqueName: \"kubernetes.io/projected/36069701-b15e-4a9b-a748-4a65b8f36272-kube-api-access-97tht\") pod \"opendatahub-operator-controller-manager-7f74b88589-nqsdz\" (UID: \"36069701-b15e-4a9b-a748-4a65b8f36272\") " pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.436795 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.436770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.524051 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.524007    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:03.539459 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.539422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.662402 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.662319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.671968 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.671934    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"]
Jul 21 19:43:03.676786 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:43:03.676761    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36069701_b15e_4a9b_a748_4a65b8f36272.slice/crio-6e955578cf8c6b1b2a653b9878e642662cb58c6b70d19a3272b0a4ea08550352 WatchSource:0}: Error finding container 6e955578cf8c6b1b2a653b9878e642662cb58c6b70d19a3272b0a4ea08550352: Status 404 returned error can't find the container with id 6e955578cf8c6b1b2a653b9878e642662cb58c6b70d19a3272b0a4ea08550352
Jul 21 19:43:03.716697 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.716663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz" event={"ID":"36069701-b15e-4a9b-a748-4a65b8f36272","Type":"ContainerStarted","Data":"6e955578cf8c6b1b2a653b9878e642662cb58c6b70d19a3272b0a4ea08550352"}
Jul 21 19:43:03.752604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.752566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:03.922401 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:03.922303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:07.737190 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:07.737155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz" event={"ID":"36069701-b15e-4a9b-a748-4a65b8f36272","Type":"ContainerStarted","Data":"72f1dcf05bebc649c827e6c11308d9484e95b32bb7adc2e42d401443305d7af1"}
Jul 21 19:43:08.741994 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:08.741960    2573 generic.go:356] "Generic (PLEG): container finished" podID="36069701-b15e-4a9b-a748-4a65b8f36272" containerID="72f1dcf05bebc649c827e6c11308d9484e95b32bb7adc2e42d401443305d7af1" exitCode=0
Jul 21 19:43:08.742378 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:08.742044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz" event={"ID":"36069701-b15e-4a9b-a748-4a65b8f36272","Type":"ContainerDied","Data":"72f1dcf05bebc649c827e6c11308d9484e95b32bb7adc2e42d401443305d7af1"}
Jul 21 19:43:09.700700 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:09.700669    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bc6b5d4fd-96z6c"
Jul 21 19:43:09.749484 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:09.749443    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz" event={"ID":"36069701-b15e-4a9b-a748-4a65b8f36272","Type":"ContainerStarted","Data":"45db0fee3ebada33f441b30c06675637159e9dca99c02eea229fbaa068a1701f"}
Jul 21 19:43:09.749942 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:09.749576    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:09.772028 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:09.771818    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz" podStartSLOduration=2.150120336 podStartE2EDuration="6.771803155s" totalImagesPullingTime="3.567031383s" totalInitContainerRuntime="1.054651436s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:43:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:43:09.771499528 +0000 UTC m=+357.484284125" watchObservedRunningTime="2026-07-21 19:43:09.771803155 +0000 UTC m=+357.484587728"
Jul 21 19:43:20.755145 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:20.755115    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f74b88589-nqsdz"
Jul 21 19:43:22.218833 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:22.218788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:22.464246 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:22.464212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:22.660127 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:22.660038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:23.296940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:23.296904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:23.656883 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:23.656788    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:23.832147 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:23.832099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:23.978479 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:23.978433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:24.090733 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:24.090688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:24.663832 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:24.663780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:24.824918 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:24.824879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:25.467908 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:25.467876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:25.567731 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:25.567673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:26.662034 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:26.661991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:31.095664 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.095621    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"]
Jul 21 19:43:31.105226 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.105201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.108396 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.108368    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6xsbl\""
Jul 21 19:43:31.108530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.108377    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 19:43:31.108530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.108378    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 19:43:31.108530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.108379    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 19:43:31.109486 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.109469    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 19:43:31.117672 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.117647    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"]
Jul 21 19:43:31.230644 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230644 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d1aaa7-98e4-4e04-b715-9838124096ff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230863 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6mdb\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-kube-api-access-n6mdb\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230863 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230863 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230863 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.230985 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.230868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331285 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331285 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d1aaa7-98e4-4e04-b715-9838124096ff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6mdb\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-kube-api-access-n6mdb\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.331515 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.331465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.332137 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.332107    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.333815 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.333793    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.333917 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.333819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.334090 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.334072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.334126 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.334068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d1aaa7-98e4-4e04-b715-9838124096ff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.347384 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.347324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6mdb\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-kube-api-access-n6mdb\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.367767 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.367745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d1aaa7-98e4-4e04-b715-9838124096ff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cf6bp\" (UID: \"55d1aaa7-98e4-4e04-b715-9838124096ff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.414223 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.414196    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:31.570941 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.570919    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"]
Jul 21 19:43:31.573217 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:43:31.573186    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d1aaa7_98e4_4e04_b715_9838124096ff.slice/crio-00ab691429aa75ac8bf032e091c4e6f427be4112d871022a4feb3cf247ab1f8e WatchSource:0}: Error finding container 00ab691429aa75ac8bf032e091c4e6f427be4112d871022a4feb3cf247ab1f8e: Status 404 returned error can't find the container with id 00ab691429aa75ac8bf032e091c4e6f427be4112d871022a4feb3cf247ab1f8e
Jul 21 19:43:31.698638 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.698553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:31.812877 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.812842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:31.841235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:31.841202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp" event={"ID":"55d1aaa7-98e4-4e04-b715-9838124096ff","Type":"ContainerStarted","Data":"00ab691429aa75ac8bf032e091c4e6f427be4112d871022a4feb3cf247ab1f8e"}
Jul 21 19:43:32.130943 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:32.130881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:32.380485 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:32.380392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:32.895205 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:32.895169    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:33.778250 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:33.778214    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 19:43:33.778485 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:33.778285    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 19:43:33.853441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:33.853404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp" event={"ID":"55d1aaa7-98e4-4e04-b715-9838124096ff","Type":"ContainerStarted","Data":"a075868a3faf0361dbc0da2ee48c716d991779723fc2628b5a7ef932b8626f73"}
Jul 21 19:43:33.853594 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:33.853524    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:33.900932 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:33.900876    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp" podStartSLOduration=0.698023416 podStartE2EDuration="2.900859059s" totalImagesPullingTime="2.202835643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:43:33.899054238 +0000 UTC m=+381.611838847" watchObservedRunningTime="2026-07-21 19:43:33.900859059 +0000 UTC m=+381.613643632"
Jul 21 19:43:34.446147 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:34.446114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:34.633280 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:34.633247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:34.860985 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:34.860957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cf6bp"
Jul 21 19:43:34.872470 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:34.872440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:35.050943 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:35.050909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:35.361868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:35.361834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:43:59.314194 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:43:59.314156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:23.919707 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:23.919672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:24.017736 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:24.017681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:24.118441 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:24.118402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:24.841653 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:24.841617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:25.051194 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:25.051151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:29.270142 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:29.270108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:29.339479 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:29.339440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:36.462862 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:36.462770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:47.758961 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:47.758921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:47.860861 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:47.860823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:47.927932 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:47.927893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:44:56.187943 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:44:56.187898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:00.593982 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:00.593945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:04.580097 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:04.580050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:05.163799 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:05.163758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:05.871900 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:05.871856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:05.976422 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:05.976391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:09.268210 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:09.268174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:09.391759 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:09.391705    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:09.588789 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:09.588689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:12.023969 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:12.023920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:13.380526 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:13.380481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:13.482862 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:13.482827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:13.781916 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:13.781876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:13.980795 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:13.980757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:16.975314 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:16.975277    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:17.397908 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:17.397822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:26.399957 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:26.399920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:26.499527 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:26.499488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:29.408164 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:29.408126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:29.514678 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:29.514640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:31.899688 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:31.899645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:32.015463 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:32.015425    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:35.304673 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:35.304623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:35.403817 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:35.403776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:44.122359 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:44.122310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:44.227041 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:44.227002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:47.138456 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:47.138419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:47.236168 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:47.236129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:48.272337 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:48.272267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:48.376579 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:48.376535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:49.748133 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:49.748099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:49.848917 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:49.848889    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:53.506225 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:53.506193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:53.597759 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:53.597688    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:53.699052 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:53.699020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:53.879461 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:53.879372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:56.015734 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:56.015669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:56.118057 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:56.118024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:56.219081 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:56.219043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:56.934216 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:56.934185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:57.071691 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.071648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:45:57.113743 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.113690    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:45:57.116886 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.116869    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:45:57.122490 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.122466    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 19:45:57.122635 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.122505    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 19:45:57.122635 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.122502    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vhxmq\""
Jul 21 19:45:57.127545 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.127521    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:45:57.295050 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.295006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnlqv\" (UniqueName: \"kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv\") pod \"authorino-75d556bd77-bk2vn\" (UID: \"6bf07970-00e1-4a99-8916-2fe1350e13a6\") " pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:45:57.396404 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.396360    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnlqv\" (UniqueName: \"kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv\") pod \"authorino-75d556bd77-bk2vn\" (UID: \"6bf07970-00e1-4a99-8916-2fe1350e13a6\") " pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:45:57.405755 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.405705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnlqv\" (UniqueName: \"kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv\") pod \"authorino-75d556bd77-bk2vn\" (UID: \"6bf07970-00e1-4a99-8916-2fe1350e13a6\") " pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:45:57.426442 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.426413    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:45:57.557955 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:57.557881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:45:57.561019 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:45:57.560996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf07970_00e1_4a99_8916_2fe1350e13a6.slice/crio-1762cd2c4ed61b96ba0203b8cffc7bd0b42b24f88406c513bd776409338734e1 WatchSource:0}: Error finding container 1762cd2c4ed61b96ba0203b8cffc7bd0b42b24f88406c513bd776409338734e1: Status 404 returned error can't find the container with id 1762cd2c4ed61b96ba0203b8cffc7bd0b42b24f88406c513bd776409338734e1
Jul 21 19:45:58.453604 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:45:58.453516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bk2vn" event={"ID":"6bf07970-00e1-4a99-8916-2fe1350e13a6","Type":"ContainerStarted","Data":"1762cd2c4ed61b96ba0203b8cffc7bd0b42b24f88406c513bd776409338734e1"}
Jul 21 19:46:01.468030 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:01.467987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bk2vn" event={"ID":"6bf07970-00e1-4a99-8916-2fe1350e13a6","Type":"ContainerStarted","Data":"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"}
Jul 21 19:46:01.485479 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:01.485429    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bk2vn" podStartSLOduration=1.6257652710000001 podStartE2EDuration="4.485413386s" totalImagesPullingTime="2.859648115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:01.484331555 +0000 UTC m=+529.197116138" watchObservedRunningTime="2026-07-21 19:46:01.485413386 +0000 UTC m=+529.198197965"
Jul 21 19:46:03.546788 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:03.546710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:03.645235 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:03.645194    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:06.567238 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:06.567152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:06.660931 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:06.660899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:12.213066 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:12.213029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:12.310843 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:12.310814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:12.720469 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:12.720429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:26.236233 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.236183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:26.466337 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.466303    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:26.470709 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.470679    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:26.479013 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.478980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:26.518393 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.518293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rczgj\" (UniqueName: \"kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj\") pod \"authorino-5d4b67c446-28ncg\" (UID: \"1e123b74-681e-4aaa-80a8-2372e2daca10\") " pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:26.524939 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.524910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:26.619252 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.619219    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rczgj\" (UniqueName: \"kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj\") pod \"authorino-5d4b67c446-28ncg\" (UID: \"1e123b74-681e-4aaa-80a8-2372e2daca10\") " pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:26.627782 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.627751    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rczgj\" (UniqueName: \"kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj\") pod \"authorino-5d4b67c446-28ncg\" (UID: \"1e123b74-681e-4aaa-80a8-2372e2daca10\") " pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:26.703670 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.703631    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:26.703913 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.703898    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:26.731828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.731796    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:26.734484 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.734466    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:26.745169 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.745139    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:26.821426 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.821390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6wb\" (UniqueName: \"kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb\") pod \"authorino-7d484fbcb7-thlrw\" (UID: \"9ec7bf2a-b923-407f-bf70-16e727c104d7\") " pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:26.842812 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.842783    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:26.845587 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:46:26.845560    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e123b74_681e_4aaa_80a8_2372e2daca10.slice/crio-261bb08096ce3acc22e95a28dd7ec08480db49eb3c26e8f2807b759a64b4fd87 WatchSource:0}: Error finding container 261bb08096ce3acc22e95a28dd7ec08480db49eb3c26e8f2807b759a64b4fd87: Status 404 returned error can't find the container with id 261bb08096ce3acc22e95a28dd7ec08480db49eb3c26e8f2807b759a64b4fd87
Jul 21 19:46:26.922671 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.922633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6wb\" (UniqueName: \"kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb\") pod \"authorino-7d484fbcb7-thlrw\" (UID: \"9ec7bf2a-b923-407f-bf70-16e727c104d7\") " pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:26.939416 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.939381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6wb\" (UniqueName: \"kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb\") pod \"authorino-7d484fbcb7-thlrw\" (UID: \"9ec7bf2a-b923-407f-bf70-16e727c104d7\") " pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:26.961666 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.961629    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:26.961939 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:26.961925    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:27.059563 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.059522    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:46:27.062356 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.062331    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.065211 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.065184    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 19:46:27.070780 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.070748    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:46:27.094136 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.094109    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:27.096012 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:46:27.095981    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ec7bf2a_b923_407f_bf70_16e727c104d7.slice/crio-1a8ef85893eb5b091fb9ec27cc96747b049d4479516fb8fed7ade96154348384 WatchSource:0}: Error finding container 1a8ef85893eb5b091fb9ec27cc96747b049d4479516fb8fed7ade96154348384: Status 404 returned error can't find the container with id 1a8ef85893eb5b091fb9ec27cc96747b049d4479516fb8fed7ade96154348384
Jul 21 19:46:27.124542 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.124509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.124746 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.124658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvms\" (UniqueName: \"kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.225912 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.225870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvms\" (UniqueName: \"kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.226106 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.225928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.228284 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.228264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.234804 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.234786    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvms\" (UniqueName: \"kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms\") pod \"authorino-6847f845cf-rx6mf\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") " pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.372850 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.372809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:46:27.514649 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.514625    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:46:27.516558 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:46:27.516532    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda45a317d_eee6_4493_adbd_6ba1ecd8d461.slice/crio-76ed3fd55fc914d3e393ff163672236f169fc10cde400637b5789c94ffacdb04 WatchSource:0}: Error finding container 76ed3fd55fc914d3e393ff163672236f169fc10cde400637b5789c94ffacdb04: Status 404 returned error can't find the container with id 76ed3fd55fc914d3e393ff163672236f169fc10cde400637b5789c94ffacdb04
Jul 21 19:46:27.583973 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.583856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28ncg" event={"ID":"1e123b74-681e-4aaa-80a8-2372e2daca10","Type":"ContainerStarted","Data":"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"}
Jul 21 19:46:27.583973 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.583866    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-28ncg" podUID="1e123b74-681e-4aaa-80a8-2372e2daca10" containerName="authorino" containerID="cri-o://7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a" gracePeriod=30
Jul 21 19:46:27.583973 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.583913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28ncg" event={"ID":"1e123b74-681e-4aaa-80a8-2372e2daca10","Type":"ContainerStarted","Data":"261bb08096ce3acc22e95a28dd7ec08480db49eb3c26e8f2807b759a64b4fd87"}
Jul 21 19:46:27.585736 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.585684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" event={"ID":"9ec7bf2a-b923-407f-bf70-16e727c104d7","Type":"ContainerStarted","Data":"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"}
Jul 21 19:46:27.585916 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.585738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" event={"ID":"9ec7bf2a-b923-407f-bf70-16e727c104d7","Type":"ContainerStarted","Data":"1a8ef85893eb5b091fb9ec27cc96747b049d4479516fb8fed7ade96154348384"}
Jul 21 19:46:27.585916 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.585815    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" podUID="9ec7bf2a-b923-407f-bf70-16e727c104d7" containerName="authorino" containerID="cri-o://59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50" gracePeriod=30
Jul 21 19:46:27.587416 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.587385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6847f845cf-rx6mf" event={"ID":"a45a317d-eee6-4493-adbd-6ba1ecd8d461","Type":"ContainerStarted","Data":"76ed3fd55fc914d3e393ff163672236f169fc10cde400637b5789c94ffacdb04"}
Jul 21 19:46:27.604321 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.604270    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-28ncg" podStartSLOduration=1.192712103 podStartE2EDuration="1.604253524s" totalImagesPullingTime="411.541421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:27.603006371 +0000 UTC m=+555.315790945" watchObservedRunningTime="2026-07-21 19:46:27.604253524 +0000 UTC m=+555.317038097"
Jul 21 19:46:27.622763 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.622702    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" podStartSLOduration=1.276617603 podStartE2EDuration="1.622681287s" totalImagesPullingTime="346.063684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:27.622314709 +0000 UTC m=+555.335099273" watchObservedRunningTime="2026-07-21 19:46:27.622681287 +0000 UTC m=+555.335465880"
Jul 21 19:46:27.851491 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.851465    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:27.854841 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.854817    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:27.933850 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.933823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf6wb\" (UniqueName: \"kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb\") pod \"9ec7bf2a-b923-407f-bf70-16e727c104d7\" (UID: \"9ec7bf2a-b923-407f-bf70-16e727c104d7\") "
Jul 21 19:46:27.933986 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.933891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rczgj\" (UniqueName: \"kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj\") pod \"1e123b74-681e-4aaa-80a8-2372e2daca10\" (UID: \"1e123b74-681e-4aaa-80a8-2372e2daca10\") "
Jul 21 19:46:27.935950 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.935917    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb" (OuterVolumeSpecName: "kube-api-access-gf6wb") pod "9ec7bf2a-b923-407f-bf70-16e727c104d7" (UID: "9ec7bf2a-b923-407f-bf70-16e727c104d7"). InnerVolumeSpecName "kube-api-access-gf6wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:46:27.936073 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:27.935994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj" (OuterVolumeSpecName: "kube-api-access-rczgj") pod "1e123b74-681e-4aaa-80a8-2372e2daca10" (UID: "1e123b74-681e-4aaa-80a8-2372e2daca10"). InnerVolumeSpecName "kube-api-access-rczgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:46:28.035190 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.035156    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rczgj\" (UniqueName: \"kubernetes.io/projected/1e123b74-681e-4aaa-80a8-2372e2daca10-kube-api-access-rczgj\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:46:28.035190 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.035184    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf6wb\" (UniqueName: \"kubernetes.io/projected/9ec7bf2a-b923-407f-bf70-16e727c104d7-kube-api-access-gf6wb\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:46:28.593679 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.593644    2573 generic.go:356] "Generic (PLEG): container finished" podID="1e123b74-681e-4aaa-80a8-2372e2daca10" containerID="7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a" exitCode=0
Jul 21 19:46:28.594140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.593690    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28ncg"
Jul 21 19:46:28.594140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.593741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28ncg" event={"ID":"1e123b74-681e-4aaa-80a8-2372e2daca10","Type":"ContainerDied","Data":"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"}
Jul 21 19:46:28.594140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.593786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28ncg" event={"ID":"1e123b74-681e-4aaa-80a8-2372e2daca10","Type":"ContainerDied","Data":"261bb08096ce3acc22e95a28dd7ec08480db49eb3c26e8f2807b759a64b4fd87"}
Jul 21 19:46:28.594140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.593806    2573 scope.go:117] "RemoveContainer" containerID="7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"
Jul 21 19:46:28.595092 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.595066    2573 generic.go:356] "Generic (PLEG): container finished" podID="9ec7bf2a-b923-407f-bf70-16e727c104d7" containerID="59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50" exitCode=0
Jul 21 19:46:28.595194 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.595112    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d484fbcb7-thlrw"
Jul 21 19:46:28.595194 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.595156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" event={"ID":"9ec7bf2a-b923-407f-bf70-16e727c104d7","Type":"ContainerDied","Data":"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"}
Jul 21 19:46:28.595318 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.595195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d484fbcb7-thlrw" event={"ID":"9ec7bf2a-b923-407f-bf70-16e727c104d7","Type":"ContainerDied","Data":"1a8ef85893eb5b091fb9ec27cc96747b049d4479516fb8fed7ade96154348384"}
Jul 21 19:46:28.597320 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.597295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6847f845cf-rx6mf" event={"ID":"a45a317d-eee6-4493-adbd-6ba1ecd8d461","Type":"ContainerStarted","Data":"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"}
Jul 21 19:46:28.602176 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.602153    2573 scope.go:117] "RemoveContainer" containerID="7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"
Jul 21 19:46:28.602432 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:28.602414    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a\": container with ID starting with 7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a not found: ID does not exist" containerID="7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"
Jul 21 19:46:28.602499 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.602440    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a"} err="failed to get container status \"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a\": rpc error: code = NotFound desc = could not find container \"7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a\": container with ID starting with 7b09c2adb4922c62a8a9e57391ff2457370fb0829e53b2dcfe6dd48a8d3db38a not found: ID does not exist"
Jul 21 19:46:28.602499 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.602456    2573 scope.go:117] "RemoveContainer" containerID="59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"
Jul 21 19:46:28.609467 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.609451    2573 scope.go:117] "RemoveContainer" containerID="59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"
Jul 21 19:46:28.609703 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:28.609684    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50\": container with ID starting with 59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50 not found: ID does not exist" containerID="59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"
Jul 21 19:46:28.609787 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.609727    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50"} err="failed to get container status \"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50\": rpc error: code = NotFound desc = could not find container \"59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50\": container with ID starting with 59f92729fbee2b71f196550cb9142e07ecd04025023d39b1ddf49c59181b1b50 not found: ID does not exist"
Jul 21 19:46:28.614222 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.614200    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:28.618278 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.618255    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d484fbcb7-thlrw"]
Jul 21 19:46:28.632927 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.632879    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6847f845cf-rx6mf" podStartSLOduration=1.271344877 podStartE2EDuration="1.632861704s" totalImagesPullingTime="361.516827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:28.632682884 +0000 UTC m=+556.345467457" watchObservedRunningTime="2026-07-21 19:46:28.632861704 +0000 UTC m=+556.345646280"
Jul 21 19:46:28.653226 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.653201    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:28.663076 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.663048    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28ncg"]
Jul 21 19:46:28.673520 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.673452    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:46:28.673640 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.673620    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bk2vn" podUID="6bf07970-00e1-4a99-8916-2fe1350e13a6" containerName="authorino" containerID="cri-o://fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46" gracePeriod=30
Jul 21 19:46:28.926789 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:28.926710    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:46:29.044205 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.044166    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnlqv\" (UniqueName: \"kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv\") pod \"6bf07970-00e1-4a99-8916-2fe1350e13a6\" (UID: \"6bf07970-00e1-4a99-8916-2fe1350e13a6\") "
Jul 21 19:46:29.046273 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.046238    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv" (OuterVolumeSpecName: "kube-api-access-bnlqv") pod "6bf07970-00e1-4a99-8916-2fe1350e13a6" (UID: "6bf07970-00e1-4a99-8916-2fe1350e13a6"). InnerVolumeSpecName "kube-api-access-bnlqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:46:29.145269 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.145235    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnlqv\" (UniqueName: \"kubernetes.io/projected/6bf07970-00e1-4a99-8916-2fe1350e13a6-kube-api-access-bnlqv\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:46:29.603874 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.603838    2573 generic.go:356] "Generic (PLEG): container finished" podID="6bf07970-00e1-4a99-8916-2fe1350e13a6" containerID="fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46" exitCode=0
Jul 21 19:46:29.604275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.603881    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bk2vn"
Jul 21 19:46:29.604275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.603923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bk2vn" event={"ID":"6bf07970-00e1-4a99-8916-2fe1350e13a6","Type":"ContainerDied","Data":"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"}
Jul 21 19:46:29.604275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.603965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bk2vn" event={"ID":"6bf07970-00e1-4a99-8916-2fe1350e13a6","Type":"ContainerDied","Data":"1762cd2c4ed61b96ba0203b8cffc7bd0b42b24f88406c513bd776409338734e1"}
Jul 21 19:46:29.604275 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.603994    2573 scope.go:117] "RemoveContainer" containerID="fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"
Jul 21 19:46:29.616596 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.616575    2573 scope.go:117] "RemoveContainer" containerID="fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"
Jul 21 19:46:29.616962 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:29.616939    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46\": container with ID starting with fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46 not found: ID does not exist" containerID="fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"
Jul 21 19:46:29.617039 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.616971    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46"} err="failed to get container status \"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46\": rpc error: code = NotFound desc = could not find container \"fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46\": container with ID starting with fce80638357eefb57b3cae1703fad2f014d66ab2012093370e510bd4ad394d46 not found: ID does not exist"
Jul 21 19:46:29.640968 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.640932    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:46:29.646374 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:29.646351    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bk2vn"]
Jul 21 19:46:30.414600 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:30.414564    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e123b74-681e-4aaa-80a8-2372e2daca10" path="/var/lib/kubelet/pods/1e123b74-681e-4aaa-80a8-2372e2daca10/volumes"
Jul 21 19:46:30.414929 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:30.414907    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf07970-00e1-4a99-8916-2fe1350e13a6" path="/var/lib/kubelet/pods/6bf07970-00e1-4a99-8916-2fe1350e13a6/volumes"
Jul 21 19:46:30.415209 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:30.415197    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec7bf2a-b923-407f-bf70-16e727c104d7" path="/var/lib/kubelet/pods/9ec7bf2a-b923-407f-bf70-16e727c104d7/volumes"
Jul 21 19:46:33.658487 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.658449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:33.681108 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681080    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:33.681355 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681343    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf07970-00e1-4a99-8916-2fe1350e13a6" containerName="authorino"
Jul 21 19:46:33.681409 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681359    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf07970-00e1-4a99-8916-2fe1350e13a6" containerName="authorino"
Jul 21 19:46:33.681409 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681380    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec7bf2a-b923-407f-bf70-16e727c104d7" containerName="authorino"
Jul 21 19:46:33.681409 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681387    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec7bf2a-b923-407f-bf70-16e727c104d7" containerName="authorino"
Jul 21 19:46:33.681409 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681398    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e123b74-681e-4aaa-80a8-2372e2daca10" containerName="authorino"
Jul 21 19:46:33.681409 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681404    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e123b74-681e-4aaa-80a8-2372e2daca10" containerName="authorino"
Jul 21 19:46:33.681547 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681459    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf07970-00e1-4a99-8916-2fe1350e13a6" containerName="authorino"
Jul 21 19:46:33.681547 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681468    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e123b74-681e-4aaa-80a8-2372e2daca10" containerName="authorino"
Jul 21 19:46:33.681547 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.681473    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec7bf2a-b923-407f-bf70-16e727c104d7" containerName="authorino"
Jul 21 19:46:33.685523 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.685505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:33.688329 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.688308    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 19:46:33.688900 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.688883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 19:46:33.688965 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.688953    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rxdzz\""
Jul 21 19:46:33.712735 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.698934    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:33.757902 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.757860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:33.786871 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.786841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:33.787002 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.786880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8zd\" (UniqueName: \"kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:33.825530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.825498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:33.888073 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.888037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:33.888195 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.888095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8zd\" (UniqueName: \"kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:33.888244 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:33.888192    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 19:46:33.888287 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:33.888275    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert podName:a6d1d9ba-b3fd-428a-8119-01de687d5f6e nodeName:}" failed. No retries permitted until 2026-07-21 19:46:34.388255561 +0000 UTC m=+562.101040118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert") pod "maas-controller-d8887448c-hcgs5" (UID: "a6d1d9ba-b3fd-428a-8119-01de687d5f6e") : secret "maas-controller-webhook-cert" not found
Jul 21 19:46:33.899670 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:33.899646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8zd\" (UniqueName: \"kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:34.021932 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:34.021880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:34.392258 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:34.392167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:34.394567 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:34.394544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") pod \"maas-controller-d8887448c-hcgs5\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") " pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:34.598224 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:34.598185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:34.731018 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:34.730993    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:34.733571 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:46:34.733543    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d1d9ba_b3fd_428a_8119_01de687d5f6e.slice/crio-316f28220ea5024f0c5c48e81e47d760392059919ef189e77b1d20e5c06dd3ee WatchSource:0}: Error finding container 316f28220ea5024f0c5c48e81e47d760392059919ef189e77b1d20e5c06dd3ee: Status 404 returned error can't find the container with id 316f28220ea5024f0c5c48e81e47d760392059919ef189e77b1d20e5c06dd3ee
Jul 21 19:46:35.635056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:35.635017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8887448c-hcgs5" event={"ID":"a6d1d9ba-b3fd-428a-8119-01de687d5f6e","Type":"ContainerStarted","Data":"316f28220ea5024f0c5c48e81e47d760392059919ef189e77b1d20e5c06dd3ee"}
Jul 21 19:46:36.803843 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:36.803804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:36.901774 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:36.901738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:46:37.645265 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:37.645228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8887448c-hcgs5" event={"ID":"a6d1d9ba-b3fd-428a-8119-01de687d5f6e","Type":"ContainerStarted","Data":"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"}
Jul 21 19:46:37.645463 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:37.645290    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:37.677264 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:37.677213    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d8887448c-hcgs5" podStartSLOduration=2.403030505 podStartE2EDuration="4.677197464s" totalImagesPullingTime="2.274166959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:46:37.676182524 +0000 UTC m=+565.388967097" watchObservedRunningTime="2026-07-21 19:46:37.677197464 +0000 UTC m=+565.389982036"
Jul 21 19:46:48.011004 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.010964    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:48.011450 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.011207    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d8887448c-hcgs5" podUID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" containerName="manager" containerID="cri-o://d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3" gracePeriod=30
Jul 21 19:46:48.012836 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.012814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:48.255507 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.255482    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:48.411198 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.411099    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8zd\" (UniqueName: \"kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd\") pod \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") "
Jul 21 19:46:48.411198 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.411164    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") pod \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\" (UID: \"a6d1d9ba-b3fd-428a-8119-01de687d5f6e\") "
Jul 21 19:46:48.413443 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.413410    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a6d1d9ba-b3fd-428a-8119-01de687d5f6e" (UID: "a6d1d9ba-b3fd-428a-8119-01de687d5f6e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 19:46:48.413561 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.413457    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd" (OuterVolumeSpecName: "kube-api-access-cg8zd") pod "a6d1d9ba-b3fd-428a-8119-01de687d5f6e" (UID: "a6d1d9ba-b3fd-428a-8119-01de687d5f6e"). InnerVolumeSpecName "kube-api-access-cg8zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:46:48.512477 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.512438    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-webhook-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:46:48.512477 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.512469    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8zd\" (UniqueName: \"kubernetes.io/projected/a6d1d9ba-b3fd-428a-8119-01de687d5f6e-kube-api-access-cg8zd\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:46:48.691554 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.691474    2573 generic.go:356] "Generic (PLEG): container finished" podID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" containerID="d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3" exitCode=0
Jul 21 19:46:48.691554 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.691521    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8887448c-hcgs5"
Jul 21 19:46:48.691765 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.691552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8887448c-hcgs5" event={"ID":"a6d1d9ba-b3fd-428a-8119-01de687d5f6e","Type":"ContainerDied","Data":"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"}
Jul 21 19:46:48.691765 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.691606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8887448c-hcgs5" event={"ID":"a6d1d9ba-b3fd-428a-8119-01de687d5f6e","Type":"ContainerDied","Data":"316f28220ea5024f0c5c48e81e47d760392059919ef189e77b1d20e5c06dd3ee"}
Jul 21 19:46:48.691765 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.691629    2573 scope.go:117] "RemoveContainer" containerID="d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"
Jul 21 19:46:48.699840 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.699699    2573 scope.go:117] "RemoveContainer" containerID="d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"
Jul 21 19:46:48.699995 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:46:48.699976    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3\": container with ID starting with d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3 not found: ID does not exist" containerID="d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"
Jul 21 19:46:48.700060 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.700002    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3"} err="failed to get container status \"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3\": rpc error: code = NotFound desc = could not find container \"d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3\": container with ID starting with d90682aa1e013fb7ed2e9a01d8628bfcb7c6fb1de9133d52952678358564d3a3 not found: ID does not exist"
Jul 21 19:46:48.710962 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.710940    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:48.715384 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:48.715364    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d8887448c-hcgs5"]
Jul 21 19:46:50.414508 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:46:50.414472    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" path="/var/lib/kubelet/pods/a6d1d9ba-b3fd-428a-8119-01de687d5f6e/volumes"
Jul 21 19:47:08.508072 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:08.508031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:08.607570 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:08.607516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:09.017485 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.017454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:09.122455 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.122413    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"]
Jul 21 19:47:09.122819 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.122802    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" containerName="manager"
Jul 21 19:47:09.122911 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.122821    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" containerName="manager"
Jul 21 19:47:09.122976 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.122910    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d1d9ba-b3fd-428a-8119-01de687d5f6e" containerName="manager"
Jul 21 19:47:09.128873 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.128851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.132733 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.132695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6lb6m\""
Jul 21 19:47:09.132733 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.132712    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 19:47:09.132733 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.132727    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 19:47:09.132983 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.132701    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 19:47:09.134450 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.134365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:09.135503 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.135477    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"]
Jul 21 19:47:09.183698 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.183663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28457552-ceff-47ce-9a90-df85fbe143c3-maas-api-tls\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.183885 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.183774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrl7\" (UniqueName: \"kubernetes.io/projected/28457552-ceff-47ce-9a90-df85fbe143c3-kube-api-access-zrrl7\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.183885 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.183802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28457552-ceff-47ce-9a90-df85fbe143c3-openshift-service-ca\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.285113 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.285028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrl7\" (UniqueName: \"kubernetes.io/projected/28457552-ceff-47ce-9a90-df85fbe143c3-kube-api-access-zrrl7\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.285113 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.285072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28457552-ceff-47ce-9a90-df85fbe143c3-openshift-service-ca\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.285113 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.285113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28457552-ceff-47ce-9a90-df85fbe143c3-maas-api-tls\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.285690 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.285658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28457552-ceff-47ce-9a90-df85fbe143c3-openshift-service-ca\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.287454 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.287432    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28457552-ceff-47ce-9a90-df85fbe143c3-maas-api-tls\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.293654 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.293633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrl7\" (UniqueName: \"kubernetes.io/projected/28457552-ceff-47ce-9a90-df85fbe143c3-kube-api-access-zrrl7\") pod \"maas-api-74dd9b6d54-k9zjj\" (UID: \"28457552-ceff-47ce-9a90-df85fbe143c3\") " pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.440496 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.440460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:09.598747 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.598710    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"]
Jul 21 19:47:09.602288 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:47:09.602255    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28457552_ceff_47ce_9a90_df85fbe143c3.slice/crio-30d1727f34518945c433bbfb41ec753730b44f0e22e7e423e9c1174a48f8a0df WatchSource:0}: Error finding container 30d1727f34518945c433bbfb41ec753730b44f0e22e7e423e9c1174a48f8a0df: Status 404 returned error can't find the container with id 30d1727f34518945c433bbfb41ec753730b44f0e22e7e423e9c1174a48f8a0df
Jul 21 19:47:09.658732 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.658693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:09.754088 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.754060    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:09.790756 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:09.790697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj" event={"ID":"28457552-ceff-47ce-9a90-df85fbe143c3","Type":"ContainerStarted","Data":"30d1727f34518945c433bbfb41ec753730b44f0e22e7e423e9c1174a48f8a0df"}
Jul 21 19:47:11.801372 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:11.801273    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj" event={"ID":"28457552-ceff-47ce-9a90-df85fbe143c3","Type":"ContainerStarted","Data":"ba248471e69c36eb223a6f181144eb3de24746a11f6ba87712c59a9fc4fe8c6c"}
Jul 21 19:47:11.801372 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:11.801362    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:11.830473 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:11.830423    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj" podStartSLOduration=0.906274957 podStartE2EDuration="2.830407558s" totalImagesPullingTime="1.924132601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:11.830168179 +0000 UTC m=+599.542952752" watchObservedRunningTime="2026-07-21 19:47:11.830407558 +0000 UTC m=+599.543192132"
Jul 21 19:47:17.811652 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:17.811620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74dd9b6d54-k9zjj"
Jul 21 19:47:19.841502 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:19.841462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:19.933779 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:19.933746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:25.733808 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:25.733766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:33.901291 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.901252    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"]
Jul 21 19:47:33.905244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.905221    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.909119 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.909097    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 19:47:33.909234 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.909097    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 19:47:33.909234 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.909178    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wn54b\""
Jul 21 19:47:33.909234 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.909214    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 19:47:33.913679 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.913655    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"]
Jul 21 19:47:33.938985 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.938957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:33.991699 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7d0782-d416-493e-821b-04929c5d9f1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.991864 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsknk\" (UniqueName: \"kubernetes.io/projected/ac7d0782-d416-493e-821b-04929c5d9f1a-kube-api-access-wsknk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.991864 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.991953 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.991953 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:33.991953 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:33.991930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093129 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7d0782-d416-493e-821b-04929c5d9f1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsknk\" (UniqueName: \"kubernetes.io/projected/ac7d0782-d416-493e-821b-04929c5d9f1a-kube-api-access-wsknk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093276 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093671 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093813 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.093813 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.093706    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.095438 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.095418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0782-d416-493e-821b-04929c5d9f1a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.095749 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.095705    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7d0782-d416-493e-821b-04929c5d9f1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.100564 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.100546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsknk\" (UniqueName: \"kubernetes.io/projected/ac7d0782-d416-493e-821b-04929c5d9f1a-kube-api-access-wsknk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jr6pg\" (UID: \"ac7d0782-d416-493e-821b-04929c5d9f1a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.216449 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.216415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:34.344644 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.344612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"]
Jul 21 19:47:34.348536 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:47:34.348505    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7d0782_d416_493e_821b_04929c5d9f1a.slice/crio-c0807304a8e6273e76a25bd20b32ac312ca8726a9359e82720cb2458ba4abd3b WatchSource:0}: Error finding container c0807304a8e6273e76a25bd20b32ac312ca8726a9359e82720cb2458ba4abd3b: Status 404 returned error can't find the container with id c0807304a8e6273e76a25bd20b32ac312ca8726a9359e82720cb2458ba4abd3b
Jul 21 19:47:34.350059 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.350038    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 19:47:34.909781 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:34.909732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg" event={"ID":"ac7d0782-d416-493e-821b-04929c5d9f1a","Type":"ContainerStarted","Data":"c0807304a8e6273e76a25bd20b32ac312ca8726a9359e82720cb2458ba4abd3b"}
Jul 21 19:47:35.915485 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:35.915446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg" event={"ID":"ac7d0782-d416-493e-821b-04929c5d9f1a","Type":"ContainerStarted","Data":"e5919e474798e385b8c806210c16076f1bc40d543e70f26795fc0e01c5186717"}
Jul 21 19:47:35.934044 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:35.933991    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg" podStartSLOduration=1.837216535 podStartE2EDuration="2.93397647s" totalImagesPullingTime="1.096759935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:35.932297425 +0000 UTC m=+623.645082019" watchObservedRunningTime="2026-07-21 19:47:35.93397647 +0000 UTC m=+623.646761043"
Jul 21 19:47:41.123423 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:41.123387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:41.224371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:41.224332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:44.216792 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:44.216751    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:44.217288 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:44.216859    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:44.229116 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:44.229093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:44.962700 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:44.962670    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jr6pg"
Jul 21 19:47:46.336865 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:46.336820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:55.299050 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.299002    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"]
Jul 21 19:47:55.301493 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.301473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.304179 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.304161    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 19:47:55.311843 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.311818    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"]
Jul 21 19:47:55.357251 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.357208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:47:55.366451 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.366528 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c586026f-f9b9-4ae7-945f-550143772aba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.366528 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.366601 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.366601 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shd4r\" (UniqueName: \"kubernetes.io/projected/c586026f-f9b9-4ae7-945f-550143772aba-kube-api-access-shd4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.366675 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.366612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.466961 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.466920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.466961 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.466964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shd4r\" (UniqueName: \"kubernetes.io/projected/c586026f-f9b9-4ae7-945f-550143772aba-kube-api-access-shd4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467217 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.466999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467217 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467019    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467217 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c586026f-f9b9-4ae7-945f-550143772aba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467217 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467428 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467326    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467600 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.467662 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.467632    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.469530 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.469503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c586026f-f9b9-4ae7-945f-550143772aba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.469652 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.469613    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c586026f-f9b9-4ae7-945f-550143772aba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.478711 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.478679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shd4r\" (UniqueName: \"kubernetes.io/projected/c586026f-f9b9-4ae7-945f-550143772aba-kube-api-access-shd4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8\" (UID: \"c586026f-f9b9-4ae7-945f-550143772aba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.612508 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.612405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:47:55.744299 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:55.744271    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"]
Jul 21 19:47:55.746649 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:47:55.746620    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc586026f_f9b9_4ae7_945f_550143772aba.slice/crio-6395b896df6b2d3d19c7ac24515d21d73a527f14a7b3f7f24cf07dac2ca28687 WatchSource:0}: Error finding container 6395b896df6b2d3d19c7ac24515d21d73a527f14a7b3f7f24cf07dac2ca28687: Status 404 returned error can't find the container with id 6395b896df6b2d3d19c7ac24515d21d73a527f14a7b3f7f24cf07dac2ca28687
Jul 21 19:47:56.000286 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:56.000244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8" event={"ID":"c586026f-f9b9-4ae7-945f-550143772aba","Type":"ContainerStarted","Data":"f0ad2459f5a71112c354d043aba6af9230f22884a111177de85c811a559ecf1d"}
Jul 21 19:47:56.000466 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:56.000317    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8" event={"ID":"c586026f-f9b9-4ae7-945f-550143772aba","Type":"ContainerStarted","Data":"6395b896df6b2d3d19c7ac24515d21d73a527f14a7b3f7f24cf07dac2ca28687"}
Jul 21 19:47:56.018743 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:56.018629    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8" podStartSLOduration=0.844680204 podStartE2EDuration="1.018611149s" totalImagesPullingTime="173.930945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:47:56.017569714 +0000 UTC m=+643.730354321" watchObservedRunningTime="2026-07-21 19:47:56.018611149 +0000 UTC m=+643.731395721"
Jul 21 19:47:59.481178 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:47:59.481130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:04.727475 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:04.727436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:05.612903 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:05.612871    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:48:05.613206 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:05.613171    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:48:05.625504 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:05.625477    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:48:06.053896 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:06.053867    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8"
Jul 21 19:48:07.327864 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:07.327827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:50.158274 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:50.158234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:50.265056 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:50.265020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:51.317140 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.317105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:51.476849 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.476807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:48:51.687590 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.687500    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:48:51.687789 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.687682    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6847f845cf-rx6mf" podUID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" containerName="authorino" containerID="cri-o://ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22" gracePeriod=30
Jul 21 19:48:51.934678 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.934649    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:48:51.948940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.948881    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert\") pod \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") "
Jul 21 19:48:51.948940 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.948928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkvms\" (UniqueName: \"kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms\") pod \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\" (UID: \"a45a317d-eee6-4493-adbd-6ba1ecd8d461\") "
Jul 21 19:48:51.951039 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.951009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms" (OuterVolumeSpecName: "kube-api-access-qkvms") pod "a45a317d-eee6-4493-adbd-6ba1ecd8d461" (UID: "a45a317d-eee6-4493-adbd-6ba1ecd8d461"). InnerVolumeSpecName "kube-api-access-qkvms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:48:51.960461 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:51.960434    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a45a317d-eee6-4493-adbd-6ba1ecd8d461" (UID: "a45a317d-eee6-4493-adbd-6ba1ecd8d461"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 19:48:52.050060 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.050024    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45a317d-eee6-4493-adbd-6ba1ecd8d461-tls-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:48:52.050060 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.050053    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkvms\" (UniqueName: \"kubernetes.io/projected/a45a317d-eee6-4493-adbd-6ba1ecd8d461-kube-api-access-qkvms\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:48:52.240645 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.240610    2573 generic.go:356] "Generic (PLEG): container finished" podID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" containerID="ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22" exitCode=0
Jul 21 19:48:52.240828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.240650    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6847f845cf-rx6mf"
Jul 21 19:48:52.240828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.240706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6847f845cf-rx6mf" event={"ID":"a45a317d-eee6-4493-adbd-6ba1ecd8d461","Type":"ContainerDied","Data":"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"}
Jul 21 19:48:52.240828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.240762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6847f845cf-rx6mf" event={"ID":"a45a317d-eee6-4493-adbd-6ba1ecd8d461","Type":"ContainerDied","Data":"76ed3fd55fc914d3e393ff163672236f169fc10cde400637b5789c94ffacdb04"}
Jul 21 19:48:52.240828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.240782    2573 scope.go:117] "RemoveContainer" containerID="ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"
Jul 21 19:48:52.249898 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.249880    2573 scope.go:117] "RemoveContainer" containerID="ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"
Jul 21 19:48:52.250162 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:48:52.250144    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22\": container with ID starting with ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22 not found: ID does not exist" containerID="ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"
Jul 21 19:48:52.250207 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.250172    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22"} err="failed to get container status \"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22\": rpc error: code = NotFound desc = could not find container \"ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22\": container with ID starting with ce1cf8585eb0ebf5e35ce059b0716b14f6ca3b1a93259387ff47f524c670ab22 not found: ID does not exist"
Jul 21 19:48:52.265176 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.265149    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:48:52.271349 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.271324    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6847f845cf-rx6mf"]
Jul 21 19:48:52.415287 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:48:52.415256    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" path="/var/lib/kubelet/pods/a45a317d-eee6-4493-adbd-6ba1ecd8d461/volumes"
Jul 21 19:49:27.392576 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:49:27.392535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:49:43.445254 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:49:43.445201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:49:43.547257 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:49:43.547222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:02.492704 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:02.492668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:28.997279 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:28.997244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:29.099463 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:29.099424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:39.665461 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.665374    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:39.666068 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.665868    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" containerName="authorino"
Jul 21 19:50:39.666068 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.665887    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" containerName="authorino"
Jul 21 19:50:39.666068 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.665982    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a45a317d-eee6-4493-adbd-6ba1ecd8d461" containerName="authorino"
Jul 21 19:50:39.668899 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.668877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.672923 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.672903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rxdzz\""
Jul 21 19:50:39.673039 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.672988    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 19:50:39.673039 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.672994    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 19:50:39.682382 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.682349    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:39.784227 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.784186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.784394 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.784296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfvlm\" (UniqueName: \"kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.884692 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.884657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfvlm\" (UniqueName: \"kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.884853 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.884708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.887054 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.887026    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.893279 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.893258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfvlm\" (UniqueName: \"kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm\") pod \"maas-controller-6dcdddffd4-cvxx8\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") " pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:39.983850 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:39.983813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:40.114752 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:40.114704    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:40.116650 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:50:40.116617    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67aa0548_49e1_4948_bf33_6d3601368705.slice/crio-9c551d55784224a034652288983593c7dae5c1ca7e0d2368ad5f79791e6f1e3c WatchSource:0}: Error finding container 9c551d55784224a034652288983593c7dae5c1ca7e0d2368ad5f79791e6f1e3c: Status 404 returned error can't find the container with id 9c551d55784224a034652288983593c7dae5c1ca7e0d2368ad5f79791e6f1e3c
Jul 21 19:50:40.717119 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:40.717094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" event={"ID":"67aa0548-49e1-4948-bf33-6d3601368705","Type":"ContainerStarted","Data":"9c551d55784224a034652288983593c7dae5c1ca7e0d2368ad5f79791e6f1e3c"}
Jul 21 19:50:41.722907 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:41.722870    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" event={"ID":"67aa0548-49e1-4948-bf33-6d3601368705","Type":"ContainerStarted","Data":"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"}
Jul 21 19:50:41.723301 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:41.722937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:41.740674 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:41.740624    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" podStartSLOduration=2.181801925 podStartE2EDuration="2.74061048s" totalImagesPullingTime="558.808555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:50:41.740020503 +0000 UTC m=+809.452805080" watchObservedRunningTime="2026-07-21 19:50:41.74061048 +0000 UTC m=+809.453395053"
Jul 21 19:50:52.731545 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:52.731510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:57.273215 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.273180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:57.377071 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.377040    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:57.377239 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.377219    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" podUID="67aa0548-49e1-4948-bf33-6d3601368705" containerName="manager" containerID="cri-o://3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d" gracePeriod=30
Jul 21 19:50:57.622786 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.622758    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:57.740251 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.740221    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfvlm\" (UniqueName: \"kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm\") pod \"67aa0548-49e1-4948-bf33-6d3601368705\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") "
Jul 21 19:50:57.740251 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.740256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert\") pod \"67aa0548-49e1-4948-bf33-6d3601368705\" (UID: \"67aa0548-49e1-4948-bf33-6d3601368705\") "
Jul 21 19:50:57.742304 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.742269    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm" (OuterVolumeSpecName: "kube-api-access-dfvlm") pod "67aa0548-49e1-4948-bf33-6d3601368705" (UID: "67aa0548-49e1-4948-bf33-6d3601368705"). InnerVolumeSpecName "kube-api-access-dfvlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 19:50:57.742408 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.742281    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "67aa0548-49e1-4948-bf33-6d3601368705" (UID: "67aa0548-49e1-4948-bf33-6d3601368705"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 19:50:57.793099 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.793067    2573 generic.go:356] "Generic (PLEG): container finished" podID="67aa0548-49e1-4948-bf33-6d3601368705" containerID="3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d" exitCode=0
Jul 21 19:50:57.793247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.793117    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8"
Jul 21 19:50:57.793247 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.793117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" event={"ID":"67aa0548-49e1-4948-bf33-6d3601368705","Type":"ContainerDied","Data":"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"}
Jul 21 19:50:57.793364 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.793261    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-cvxx8" event={"ID":"67aa0548-49e1-4948-bf33-6d3601368705","Type":"ContainerDied","Data":"9c551d55784224a034652288983593c7dae5c1ca7e0d2368ad5f79791e6f1e3c"}
Jul 21 19:50:57.793364 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.793305    2573 scope.go:117] "RemoveContainer" containerID="3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"
Jul 21 19:50:57.801578 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.801561    2573 scope.go:117] "RemoveContainer" containerID="3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"
Jul 21 19:50:57.801839 ip-10-0-134-115 kubenswrapper[2573]: E0721 19:50:57.801819    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d\": container with ID starting with 3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d not found: ID does not exist" containerID="3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"
Jul 21 19:50:57.801911 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.801847    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d"} err="failed to get container status \"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d\": rpc error: code = NotFound desc = could not find container \"3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d\": container with ID starting with 3a33d5bd93c35e1587997bfaf53df5b0b744971482fff44d8b512866cb3c7d1d not found: ID does not exist"
Jul 21 19:50:57.814624 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.814600    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:57.818492 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.818471    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-cvxx8"]
Jul 21 19:50:57.841371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.841349    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfvlm\" (UniqueName: \"kubernetes.io/projected/67aa0548-49e1-4948-bf33-6d3601368705-kube-api-access-dfvlm\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:50:57.841371 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:57.841371    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/67aa0548-49e1-4948-bf33-6d3601368705-webhook-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 19:50:58.414344 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.414312    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67aa0548-49e1-4948-bf33-6d3601368705" path="/var/lib/kubelet/pods/67aa0548-49e1-4948-bf33-6d3601368705/volumes"
Jul 21 19:50:58.502242 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.502211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:50:58.627244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.623861    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-klhst"]
Jul 21 19:50:58.627244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.624565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa0548-49e1-4948-bf33-6d3601368705" containerName="manager"
Jul 21 19:50:58.627244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.624585    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa0548-49e1-4948-bf33-6d3601368705" containerName="manager"
Jul 21 19:50:58.627244 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.624738    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa0548-49e1-4948-bf33-6d3601368705" containerName="manager"
Jul 21 19:50:58.629858 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.629826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.632998 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.632976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rxdzz\""
Jul 21 19:50:58.634254 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.634233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 19:50:58.634364 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.634261    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 19:50:58.638119 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.638024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-klhst"]
Jul 21 19:50:58.749623 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.749585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a969bb69-1f0e-41c5-9964-02ac351e0cab-webhook-cert\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.749804 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.749649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t296\" (UniqueName: \"kubernetes.io/projected/a969bb69-1f0e-41c5-9964-02ac351e0cab-kube-api-access-5t296\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.850505 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.850463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a969bb69-1f0e-41c5-9964-02ac351e0cab-webhook-cert\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.850661 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.850540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t296\" (UniqueName: \"kubernetes.io/projected/a969bb69-1f0e-41c5-9964-02ac351e0cab-kube-api-access-5t296\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.852863 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.852834    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a969bb69-1f0e-41c5-9964-02ac351e0cab-webhook-cert\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.860253 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.860233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t296\" (UniqueName: \"kubernetes.io/projected/a969bb69-1f0e-41c5-9964-02ac351e0cab-kube-api-access-5t296\") pod \"maas-controller-6dcdddffd4-klhst\" (UID: \"a969bb69-1f0e-41c5-9964-02ac351e0cab\") " pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:58.941850 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:58.941817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:59.069356 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:59.069311    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dcdddffd4-klhst"]
Jul 21 19:50:59.071695 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:50:59.071668    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda969bb69_1f0e_41c5_9964_02ac351e0cab.slice/crio-669484c4ed8264d64f1084c6191bd9d6e26665960204eea4c86ac491a6965b82 WatchSource:0}: Error finding container 669484c4ed8264d64f1084c6191bd9d6e26665960204eea4c86ac491a6965b82: Status 404 returned error can't find the container with id 669484c4ed8264d64f1084c6191bd9d6e26665960204eea4c86ac491a6965b82
Jul 21 19:50:59.804659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:59.804572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-klhst" event={"ID":"a969bb69-1f0e-41c5-9964-02ac351e0cab","Type":"ContainerStarted","Data":"d26b68732606f7b0c763cdf4abe4202559a9c3b2ac589a48c95e42e65c0cc954"}
Jul 21 19:50:59.804659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:59.804629    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dcdddffd4-klhst" event={"ID":"a969bb69-1f0e-41c5-9964-02ac351e0cab","Type":"ContainerStarted","Data":"669484c4ed8264d64f1084c6191bd9d6e26665960204eea4c86ac491a6965b82"}
Jul 21 19:50:59.804659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:59.804651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:50:59.823339 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:50:59.823290    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dcdddffd4-klhst" podStartSLOduration=1.359678363 podStartE2EDuration="1.823275415s" totalImagesPullingTime="463.597052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:50:59.820676595 +0000 UTC m=+827.533461214" watchObservedRunningTime="2026-07-21 19:50:59.823275415 +0000 UTC m=+827.536060016"
Jul 21 19:51:10.811166 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:10.811128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dcdddffd4-klhst"
Jul 21 19:51:29.768895 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:29.768834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:29.819307 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:29.819280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:34.104626 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:34.104567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:34.238782 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:34.238748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:34.366485 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:34.366392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:39.940168 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:39.940131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:40.047146 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:40.047107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:40.145853 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:40.145812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:40.311829 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:40.311797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:45.995463 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:45.995426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:51:46.095380 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:51:46.095351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:53:46.233698 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:53:46.233608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:55:16.770938 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:55:16.770840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:57:32.678204 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:57:32.678137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:57:56.324577 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:57:56.324491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:57:56.424828 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:57:56.424791    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:59:29.467304 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:29.467264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:59:33.496980 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.496940    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 19:59:33.500728 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.500698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.503326 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.503302    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-908c2342-kserve-self-signed-certs\""
Jul 21 19:59:33.509211 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.509184    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 19:59:33.533668 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.533638    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 19:59:33.628142 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.627871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.628142 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.627941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.628142 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.628095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.628142 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.628145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kxf\" (UniqueName: \"kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.628470 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.628227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.628470 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.628264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729007 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.728966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729177 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729177 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kxf\" (UniqueName: \"kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729270 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729317 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729317 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729429 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729628 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.729762 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.729703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.731594 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.731572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.731821 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.731797    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.736974 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.736952    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kxf\" (UniqueName: \"kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf\") pod \"e2e-same-id-b-908c2342-kserve-766d966d95-572qh\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") " pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.810468 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.810406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:33.941659 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:33.941620    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 19:59:33.943904 ip-10-0-134-115 kubenswrapper[2573]: W0721 19:59:33.943874    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb43ee07b_de1c_43e6_b170_97c0262d48ef.slice/crio-b4625eb67faab45dabe2cf60b6c28609b4fa845785ee2324bb5f8ab4862576b5 WatchSource:0}: Error finding container b4625eb67faab45dabe2cf60b6c28609b4fa845785ee2324bb5f8ab4862576b5: Status 404 returned error can't find the container with id b4625eb67faab45dabe2cf60b6c28609b4fa845785ee2324bb5f8ab4862576b5
Jul 21 19:59:34.033152 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:34.033116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" event={"ID":"b43ee07b-de1c-43e6-b170-97c0262d48ef","Type":"ContainerStarted","Data":"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"}
Jul 21 19:59:34.033307 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:34.033162    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" event={"ID":"b43ee07b-de1c-43e6-b170-97c0262d48ef","Type":"ContainerStarted","Data":"b4625eb67faab45dabe2cf60b6c28609b4fa845785ee2324bb5f8ab4862576b5"}
Jul 21 19:59:34.051680 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:34.051634    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" podStartSLOduration=1.051618765 podStartE2EDuration="1.051618765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:59:34.049851676 +0000 UTC m=+1341.762636252" watchObservedRunningTime="2026-07-21 19:59:34.051618765 +0000 UTC m=+1341.764403338"
Jul 21 19:59:43.811267 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:43.811226    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:43.811267 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:43.811273    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:43.823868 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:43.823844    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 19:59:44.088481 ip-10-0-134-115 kubenswrapper[2573]: I0721 19:59:44.088398    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 20:00:00.141049 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.141011    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"]
Jul 21 20:00:00.144525 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.144507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"
Jul 21 20:00:00.147002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.146974    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:00:00.151370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.151346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"]
Jul 21 20:00:00.156579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.156547    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"
Jul 21 20:00:00.284412 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.284386    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"]
Jul 21 20:00:00.287064 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:00:00.287034    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe36befe_d7f0_4250_be44_3d7506a10e81.slice/crio-7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b WatchSource:0}: Error finding container 7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b: Status 404 returned error can't find the container with id 7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b
Jul 21 20:00:00.289067 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:00.289046    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:00:01.155994 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:01.155960    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5" event={"ID":"be36befe-d7f0-4250-be44-3d7506a10e81","Type":"ContainerStarted","Data":"7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b"}
Jul 21 20:00:01.992472 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:01.992411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:00:02.956256 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:02.956211    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 20:00:03.016383 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:03.016334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:00:14.216607 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:14.216573    2573 generic.go:356] "Generic (PLEG): container finished" podID="be36befe-d7f0-4250-be44-3d7506a10e81" containerID="370caa18c04155f43c3302e68762eeecc8f84e58f33b6d3fafe6523568a0f86f" exitCode=0
Jul 21 20:00:14.217024 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:14.216692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5" event={"ID":"be36befe-d7f0-4250-be44-3d7506a10e81","Type":"ContainerDied","Data":"370caa18c04155f43c3302e68762eeecc8f84e58f33b6d3fafe6523568a0f86f"}
Jul 21 20:00:15.350902 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:15.350875    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"
Jul 21 20:00:16.226381 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:16.226347    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5"
Jul 21 20:00:16.226553 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:16.226393    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744400-2ltb5" event={"ID":"be36befe-d7f0-4250-be44-3d7506a10e81","Type":"ContainerDied","Data":"7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b"}
Jul 21 20:00:16.226553 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:16.226468    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f64cab055e3a5d66423a66d8a76658744602c15618df33d7b20811e15a8db4b"
Jul 21 20:00:17.978426 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:17.978366    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" podUID="b43ee07b-de1c-43e6-b170-97c0262d48ef" containerName="main" containerID="cri-o://5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770" gracePeriod=45
Jul 21 20:00:18.227763 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.227738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 20:00:18.235688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.235625    2573 generic.go:356] "Generic (PLEG): container finished" podID="b43ee07b-de1c-43e6-b170-97c0262d48ef" containerID="5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770" exitCode=0
Jul 21 20:00:18.235688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.235665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" event={"ID":"b43ee07b-de1c-43e6-b170-97c0262d48ef","Type":"ContainerDied","Data":"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"}
Jul 21 20:00:18.235688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.235677    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"
Jul 21 20:00:18.235895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.235704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh" event={"ID":"b43ee07b-de1c-43e6-b170-97c0262d48ef","Type":"ContainerDied","Data":"b4625eb67faab45dabe2cf60b6c28609b4fa845785ee2324bb5f8ab4862576b5"}
Jul 21 20:00:18.235895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.235754    2573 scope.go:117] "RemoveContainer" containerID="5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"
Jul 21 20:00:18.245139 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.245113    2573 scope.go:117] "RemoveContainer" containerID="5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"
Jul 21 20:00:18.245452 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:00:18.245430    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770\": container with ID starting with 5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770 not found: ID does not exist" containerID="5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"
Jul 21 20:00:18.245540 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.245465    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770"} err="failed to get container status \"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770\": rpc error: code = NotFound desc = could not find container \"5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770\": container with ID starting with 5403779b4ede2166fe315e045960254ed28f5d425380d99cbbc2a84f69b0a770 not found: ID does not exist"
Jul 21 20:00:18.321764 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.321975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321776    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.321975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321820    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8kxf\" (UniqueName: \"kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.321975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321855    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.321975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.321975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.321967    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir\") pod \"b43ee07b-de1c-43e6-b170-97c0262d48ef\" (UID: \"b43ee07b-de1c-43e6-b170-97c0262d48ef\") "
Jul 21 20:00:18.322477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.322049    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home" (OuterVolumeSpecName: "home") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:00:18.322477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.322103    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:00:18.322477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.322213    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-home\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.322477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.322271    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-model-cache\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.322477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.322293    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:00:18.324129 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.324105    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:00:18.324223 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.324131    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm" (OuterVolumeSpecName: "dshm") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:00:18.324288 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.324214    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf" (OuterVolumeSpecName: "kube-api-access-n8kxf") pod "b43ee07b-de1c-43e6-b170-97c0262d48ef" (UID: "b43ee07b-de1c-43e6-b170-97c0262d48ef"). InnerVolumeSpecName "kube-api-access-n8kxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:00:18.422756 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.422727    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-tmp-dir\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.422756 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.422757    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43ee07b-de1c-43e6-b170-97c0262d48ef-dshm\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.422974 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.422769    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8kxf\" (UniqueName: \"kubernetes.io/projected/b43ee07b-de1c-43e6-b170-97c0262d48ef-kube-api-access-n8kxf\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.422974 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.422783    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43ee07b-de1c-43e6-b170-97c0262d48ef-tls-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:00:18.552039 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.551964    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 20:00:18.555207 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:18.555182    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-908c2342-kserve-766d966d95-572qh"]
Jul 21 20:00:20.415042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:00:20.415006    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b43ee07b-de1c-43e6-b170-97c0262d48ef" path="/var/lib/kubelet/pods/b43ee07b-de1c-43e6-b170-97c0262d48ef/volumes"
Jul 21 20:03:16.604695 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:16.604617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:17.117221 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:17.117185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:40.751910 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:40.751857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:43.957651 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:43.957602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:44.142183 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:44.142145    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:44.407787 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:44.407745    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:50.334863 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:50.334824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:50.435301 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:50.435270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:50.588772 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:50.588679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:50.935391 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:50.935291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:51.293003 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:51.292969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.171834 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.171795    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.250291 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250251    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:03:53.250793 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250773    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be36befe-d7f0-4250-be44-3d7506a10e81" containerName="cleanup"
Jul 21 20:03:53.250854 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250797    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be36befe-d7f0-4250-be44-3d7506a10e81" containerName="cleanup"
Jul 21 20:03:53.250898 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250879    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b43ee07b-de1c-43e6-b170-97c0262d48ef" containerName="main"
Jul 21 20:03:53.250898 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250890    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b43ee07b-de1c-43e6-b170-97c0262d48ef" containerName="main"
Jul 21 20:03:53.251011 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.250995    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b43ee07b-de1c-43e6-b170-97c0262d48ef" containerName="main"
Jul 21 20:03:53.251084 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.251014    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="be36befe-d7f0-4250-be44-3d7506a10e81" containerName="cleanup"
Jul 21 20:03:53.254363 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.254341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.257300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.257283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fd2497fa-serving-cert\""
Jul 21 20:03:53.266733 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.266676    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:03:53.276998 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.276972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.348239 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.348193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.349221 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.349191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.349340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.349228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.349340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.349261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65lx\" (UniqueName: \"kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.450391 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.450278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65lx\" (UniqueName: \"kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.450584 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.450403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.450584 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.450436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.450584 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:03:53.450562    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-serving-cert: secret "maas-api-e2e-ait-fd2497fa-serving-cert" not found
Jul 21 20:03:53.450788 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:03:53.450630    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls podName:10786f83-8fb8-466d-ba49-ef1a5df5d60b nodeName:}" failed. No retries permitted until 2026-07-21 20:03:53.950607888 +0000 UTC m=+1601.663392438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls") pod "maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" (UID: "10786f83-8fb8-466d-ba49-ef1a5df5d60b") : secret "maas-api-e2e-ait-fd2497fa-serving-cert" not found
Jul 21 20:03:53.451240 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.451215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.461223 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.461194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65lx\" (UniqueName: \"kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.775536 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.775502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.896212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.896176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:53.954874 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.954839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:53.957306 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:53.957276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") pod \"maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:54.102231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:54.102140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:03:54.167145 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:54.167108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:54.306175 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:54.306149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:03:54.308446 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:03:54.308420    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10786f83_8fb8_466d_ba49_ef1a5df5d60b.slice/crio-58bb756b9ba63cedb9cf1b6d7308ca64013ad3d231cea1a4d22fa5f3ab65b3c5 WatchSource:0}: Error finding container 58bb756b9ba63cedb9cf1b6d7308ca64013ad3d231cea1a4d22fa5f3ab65b3c5: Status 404 returned error can't find the container with id 58bb756b9ba63cedb9cf1b6d7308ca64013ad3d231cea1a4d22fa5f3ab65b3c5
Jul 21 20:03:55.165340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:55.165250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" event={"ID":"10786f83-8fb8-466d-ba49-ef1a5df5d60b","Type":"ContainerStarted","Data":"0e9e955aec62232a745f9c649167c660f664657e9f0ee11c1566267a1c5ef60f"}
Jul 21 20:03:55.165340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:55.165304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" event={"ID":"10786f83-8fb8-466d-ba49-ef1a5df5d60b","Type":"ContainerStarted","Data":"58bb756b9ba63cedb9cf1b6d7308ca64013ad3d231cea1a4d22fa5f3ab65b3c5"}
Jul 21 20:03:55.165549 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:55.165366    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:03:55.185438 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:03:55.185392    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" podStartSLOduration=1.677212732 podStartE2EDuration="2.185377475s" totalImagesPullingTime="508.164743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:03:55.184090013 +0000 UTC m=+1602.896874586" watchObservedRunningTime="2026-07-21 20:03:55.185377475 +0000 UTC m=+1602.898162048"
Jul 21 20:04:01.175172 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:01.175086    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:04:15.715028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:15.714933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:18.835458 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:18.835420    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"]
Jul 21 20:04:18.839048 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:18.839017    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:18.841513 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:18.841494    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:04:18.845047 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:18.845024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"]
Jul 21 20:04:18.967182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:18.967146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz\" (UID: \"52069e5d-31af-480a-b4f4-da768993be4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:19.067899 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:19.067862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz\" (UID: \"52069e5d-31af-480a-b4f4-da768993be4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:19.068475 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:19.068453    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz\" (UID: \"52069e5d-31af-480a-b4f4-da768993be4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:19.153836 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:19.153745    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:19.283816 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:19.283661    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"]
Jul 21 20:04:19.285962 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:04:19.285928    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52069e5d_31af_480a_b4f4_da768993be4c.slice/crio-6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280 WatchSource:0}: Error finding container 6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280: Status 404 returned error can't find the container with id 6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280
Jul 21 20:04:20.280199 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:20.280167    2573 generic.go:356] "Generic (PLEG): container finished" podID="52069e5d-31af-480a-b4f4-da768993be4c" containerID="20c294c132ece7f36619e1cd26d3ecb83cb0b9666d394e0addc6becd38b6dc0a" exitCode=0
Jul 21 20:04:20.280584 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:20.280213    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz" event={"ID":"52069e5d-31af-480a-b4f4-da768993be4c","Type":"ContainerDied","Data":"20c294c132ece7f36619e1cd26d3ecb83cb0b9666d394e0addc6becd38b6dc0a"}
Jul 21 20:04:20.280584 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:20.280272    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz" event={"ID":"52069e5d-31af-480a-b4f4-da768993be4c","Type":"ContainerStarted","Data":"6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280"}
Jul 21 20:04:21.410811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:21.410785    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:21.486498 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:21.486472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca\") pod \"52069e5d-31af-480a-b4f4-da768993be4c\" (UID: \"52069e5d-31af-480a-b4f4-da768993be4c\") "
Jul 21 20:04:21.486828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:21.486805    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52069e5d-31af-480a-b4f4-da768993be4c" (UID: "52069e5d-31af-480a-b4f4-da768993be4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:04:21.587929 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:21.587850    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52069e5d-31af-480a-b4f4-da768993be4c-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:04:22.290158 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:22.290124    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"
Jul 21 20:04:22.290330 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:22.290127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz" event={"ID":"52069e5d-31af-480a-b4f4-da768993be4c","Type":"ContainerDied","Data":"6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280"}
Jul 21 20:04:22.290330 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:22.290263    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e50057de453dd750c725f0742bc64cf0cda3c43cd663f6c9b9c69b5875b1280"
Jul 21 20:04:29.204457 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.204422    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:04:29.204868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.204623    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" podUID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" containerName="maas-api" containerID="cri-o://0e9e955aec62232a745f9c649167c660f664657e9f0ee11c1566267a1c5ef60f" gracePeriod=30
Jul 21 20:04:29.225876 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.225851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:29.325042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.325009    2573 generic.go:356] "Generic (PLEG): container finished" podID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" containerID="0e9e955aec62232a745f9c649167c660f664657e9f0ee11c1566267a1c5ef60f" exitCode=0
Jul 21 20:04:29.325160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.325079    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" event={"ID":"10786f83-8fb8-466d-ba49-ef1a5df5d60b","Type":"ContainerDied","Data":"0e9e955aec62232a745f9c649167c660f664657e9f0ee11c1566267a1c5ef60f"}
Jul 21 20:04:29.445968 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.445943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:04:29.554024 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.553902    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca\") pod \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") "
Jul 21 20:04:29.554024 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.553959    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g65lx\" (UniqueName: \"kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx\") pod \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") "
Jul 21 20:04:29.554024 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.554007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") pod \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\" (UID: \"10786f83-8fb8-466d-ba49-ef1a5df5d60b\") "
Jul 21 20:04:29.566119 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.554246    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10786f83-8fb8-466d-ba49-ef1a5df5d60b" (UID: "10786f83-8fb8-466d-ba49-ef1a5df5d60b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:04:29.566119 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.556165    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx" (OuterVolumeSpecName: "kube-api-access-g65lx") pod "10786f83-8fb8-466d-ba49-ef1a5df5d60b" (UID: "10786f83-8fb8-466d-ba49-ef1a5df5d60b"). InnerVolumeSpecName "kube-api-access-g65lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:04:29.566119 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.556189    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10786f83-8fb8-466d-ba49-ef1a5df5d60b" (UID: "10786f83-8fb8-466d-ba49-ef1a5df5d60b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:04:29.655470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.655440    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10786f83-8fb8-466d-ba49-ef1a5df5d60b-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:04:29.655470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.655463    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g65lx\" (UniqueName: \"kubernetes.io/projected/10786f83-8fb8-466d-ba49-ef1a5df5d60b-kube-api-access-g65lx\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:04:29.655470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:29.655473    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10786f83-8fb8-466d-ba49-ef1a5df5d60b-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:04:30.330210 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.330181    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"
Jul 21 20:04:30.330619 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.330181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf" event={"ID":"10786f83-8fb8-466d-ba49-ef1a5df5d60b","Type":"ContainerDied","Data":"58bb756b9ba63cedb9cf1b6d7308ca64013ad3d231cea1a4d22fa5f3ab65b3c5"}
Jul 21 20:04:30.330619 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.330316    2573 scope.go:117] "RemoveContainer" containerID="0e9e955aec62232a745f9c649167c660f664657e9f0ee11c1566267a1c5ef60f"
Jul 21 20:04:30.352557 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.352533    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:04:30.355644 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.355618    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fd2497fa-6b478d7f88-bcqgf"]
Jul 21 20:04:30.414919 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:30.414888    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" path="/var/lib/kubelet/pods/10786f83-8fb8-466d-ba49-ef1a5df5d60b/volumes"
Jul 21 20:04:33.898970 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:33.898912    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"]
Jul 21 20:04:33.901919 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:33.901892    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fd2497fa-t86nz"]
Jul 21 20:04:33.905402 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:33.905379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:34.416005 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:34.415973    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52069e5d-31af-480a-b4f4-da768993be4c" path="/var/lib/kubelet/pods/52069e5d-31af-480a-b4f4-da768993be4c/volumes"
Jul 21 20:04:35.150614 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.150582    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:04:35.151062 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151046    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52069e5d-31af-480a-b4f4-da768993be4c" containerName="revoke-keys"
Jul 21 20:04:35.151106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151065    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="52069e5d-31af-480a-b4f4-da768993be4c" containerName="revoke-keys"
Jul 21 20:04:35.151106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151081    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" containerName="maas-api"
Jul 21 20:04:35.151106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151091    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" containerName="maas-api"
Jul 21 20:04:35.151202 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151185    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="52069e5d-31af-480a-b4f4-da768993be4c" containerName="revoke-keys"
Jul 21 20:04:35.151202 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.151199    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="10786f83-8fb8-466d-ba49-ef1a5df5d60b" containerName="maas-api"
Jul 21 20:04:35.155646 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.155623    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.158483 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.158457    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1442c0e7-gw-openshift-default-dockercfg-28v7z\""
Jul 21 20:04:35.164794 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.164769    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:04:35.202900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.202872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.202904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.202925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75dtt\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203248 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203248 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203248 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.203379 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.203240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304514 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304475    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304514 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75dtt\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.304769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.305120 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.304929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.305120 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.305033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.305120 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.305093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.305318 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.305286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.305445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.305339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.307118 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.307088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.307579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.307560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.312336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.312305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.312498 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.312483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75dtt\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt\") pod \"e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") " pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.466649 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.466613    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:35.596066 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.596036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:35.599471 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:35.599448    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:04:35.602090 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:04:35.602062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824683ca_f3dd_47f8_8ef5_97b4bcac8a29.slice/crio-e94e8c909f4df6e3d510a066918f6b47c23ebd56f3ce26220f8dd686a826edeb WatchSource:0}: Error finding container e94e8c909f4df6e3d510a066918f6b47c23ebd56f3ce26220f8dd686a826edeb: Status 404 returned error can't find the container with id e94e8c909f4df6e3d510a066918f6b47c23ebd56f3ce26220f8dd686a826edeb
Jul 21 20:04:36.359044 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:36.359006    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerStarted","Data":"e94e8c909f4df6e3d510a066918f6b47c23ebd56f3ce26220f8dd686a826edeb"}
Jul 21 20:04:38.697283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:38.697244    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:38.697562 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:38.697320    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:38.697562 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:38.697348    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:39.375143 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:39.375105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerStarted","Data":"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"}
Jul 21 20:04:39.396984 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:39.396931    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podStartSLOduration=1.30395823 podStartE2EDuration="4.396915531s" totalImagesPullingTime="3.092957301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:04:39.394147115 +0000 UTC m=+1647.106931711" watchObservedRunningTime="2026-07-21 20:04:39.396915531 +0000 UTC m=+1647.109700103"
Jul 21 20:04:39.467396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:39.467364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:39.472185 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:39.472160    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:40.381262 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.381232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:40.382140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.382121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:40.867009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.866974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:40.935664 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.935629    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:04:40.939299 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.939275    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:40.941806 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.941786    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-1442c0e7-serving-cert\""
Jul 21 20:04:40.949404 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.949365    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:04:40.967753 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:40.967702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:41.060052 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.060018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq4zc\" (UniqueName: \"kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.060268 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.060083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.060268 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.060118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.160780 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.160673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.160780 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.160746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.160965 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.160792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq4zc\" (UniqueName: \"kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.160965 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:04:41.160899    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-serving-cert: secret "maas-api-e2e-migrate-1442c0e7-serving-cert" not found
Jul 21 20:04:41.161032 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:04:41.160973    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls podName:24ef0cd1-a334-4546-a50f-cb208b5751aa nodeName:}" failed. No retries permitted until 2026-07-21 20:04:41.660953887 +0000 UTC m=+1649.373738457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls") pod "maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" (UID: "24ef0cd1-a334-4546-a50f-cb208b5751aa") : secret "maas-api-e2e-migrate-1442c0e7-serving-cert" not found
Jul 21 20:04:41.161320 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.161298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.171723 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.171697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq4zc\" (UniqueName: \"kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.214886 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.214856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:41.588403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.588365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:41.664947 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.664918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.667546 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.667503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") pod \"maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.693202 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.693172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:04:41.850811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.850709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:41.982408 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:41.982384    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:04:41.984542 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:04:41.984514    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ef0cd1_a334_4546_a50f_cb208b5751aa.slice/crio-1fca55652477be3a54d71b9bf278b974be4c108d557ebc57bc9785a275e1e823 WatchSource:0}: Error finding container 1fca55652477be3a54d71b9bf278b974be4c108d557ebc57bc9785a275e1e823: Status 404 returned error can't find the container with id 1fca55652477be3a54d71b9bf278b974be4c108d557ebc57bc9785a275e1e823
Jul 21 20:04:42.390644 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:42.390612    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" event={"ID":"24ef0cd1-a334-4546-a50f-cb208b5751aa","Type":"ContainerStarted","Data":"1fca55652477be3a54d71b9bf278b974be4c108d557ebc57bc9785a275e1e823"}
Jul 21 20:04:43.397091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:43.397050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" event={"ID":"24ef0cd1-a334-4546-a50f-cb208b5751aa","Type":"ContainerStarted","Data":"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"}
Jul 21 20:04:43.397473 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:43.397172    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:43.416996 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:43.416951    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" podStartSLOduration=3.040299657 podStartE2EDuration="3.41693683s" totalImagesPullingTime="376.637173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:04:43.415610599 +0000 UTC m=+1651.128395207" watchObservedRunningTime="2026-07-21 20:04:43.41693683 +0000 UTC m=+1651.129721422"
Jul 21 20:04:49.407782 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:49.407754    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:04:52.439271 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.439187    2573 generic.go:356] "Generic (PLEG): container finished" podID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerID="fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5" exitCode=0
Jul 21 20:04:52.439271 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.439257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerDied","Data":"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"}
Jul 21 20:04:52.439689 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.439648    2573 scope.go:117] "RemoveContainer" containerID="fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"
Jul 21 20:04:52.440662 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.440636    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:52.440736 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.440701    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:52.440783 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:52.440752    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:04:53.448982 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:53.448938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerStarted","Data":"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"}
Jul 21 20:04:53.467824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:53.467781    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:53.469104 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:53.469076    2573 patch_prober.go:28] interesting pod/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 21 20:04:53.469242 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:53.469127    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 21 20:04:54.468083 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:54.468039    2573 patch_prober.go:28] interesting pod/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 21 20:04:54.468458 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:54.468110    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 21 20:04:55.381625 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:55.381594    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:55.467872 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:55.467842    2573 patch_prober.go:28] interesting pod/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 21 20:04:55.468046 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:55.467893    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 21 20:04:56.467354 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:56.467321    2573 patch_prober.go:28] interesting pod/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 21 20:04:56.467774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:56.467374    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 21 20:04:57.471809 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:57.471780    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:04:57.472931 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:04:57.472910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:05:05.947241 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:05.943696    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"]
Jul 21 20:05:05.954700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:05.954664    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"]
Jul 21 20:05:05.954853 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:05.954806    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:05.957494 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:05.957466    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:05:05.987733 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:05.987675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82\" (UID: \"ecf84b72-3830-4c04-85c9-3148525ac7f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:06.088507 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:06.088469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82\" (UID: \"ecf84b72-3830-4c04-85c9-3148525ac7f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:06.089166 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:06.089143    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82\" (UID: \"ecf84b72-3830-4c04-85c9-3148525ac7f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:06.266017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:06.265983    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:06.400828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:06.400802    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"]
Jul 21 20:05:06.403178 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:05:06.403151    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf84b72_3830_4c04_85c9_3148525ac7f2.slice/crio-59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085 WatchSource:0}: Error finding container 59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085: Status 404 returned error can't find the container with id 59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085
Jul 21 20:05:06.516464 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:06.516379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82" event={"ID":"ecf84b72-3830-4c04-85c9-3148525ac7f2","Type":"ContainerStarted","Data":"59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085"}
Jul 21 20:05:07.521956 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:07.521918    2573 generic.go:356] "Generic (PLEG): container finished" podID="ecf84b72-3830-4c04-85c9-3148525ac7f2" containerID="14bd061fb92d9063a501b620975ca0979927441491fec8e9b1fc0886427499be" exitCode=0
Jul 21 20:05:07.522360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:07.521999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82" event={"ID":"ecf84b72-3830-4c04-85c9-3148525ac7f2","Type":"ContainerDied","Data":"14bd061fb92d9063a501b620975ca0979927441491fec8e9b1fc0886427499be"}
Jul 21 20:05:08.656624 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:08.656599    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:08.707111 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:08.707081    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca\") pod \"ecf84b72-3830-4c04-85c9-3148525ac7f2\" (UID: \"ecf84b72-3830-4c04-85c9-3148525ac7f2\") "
Jul 21 20:05:08.707445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:08.707420    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ecf84b72-3830-4c04-85c9-3148525ac7f2" (UID: "ecf84b72-3830-4c04-85c9-3148525ac7f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:05:08.808247 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:08.808156    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecf84b72-3830-4c04-85c9-3148525ac7f2-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:09.531880 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:09.531846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82" event={"ID":"ecf84b72-3830-4c04-85c9-3148525ac7f2","Type":"ContainerDied","Data":"59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085"}
Jul 21 20:05:09.532056 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:09.531902    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59fc40faadbda1c800383644ebfe509563902931068d2c64b88ab1090b59f085"
Jul 21 20:05:09.532056 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:09.531855    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"
Jul 21 20:05:16.504820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.504787    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:05:16.505339 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.505087    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" podUID="24ef0cd1-a334-4546-a50f-cb208b5751aa" containerName="maas-api" containerID="cri-o://94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870" gracePeriod=30
Jul 21 20:05:16.531546 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.531511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:16.748302 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.748276    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:05:16.775624 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.775547    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") pod \"24ef0cd1-a334-4546-a50f-cb208b5751aa\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") "
Jul 21 20:05:16.775624 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.775602    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca\") pod \"24ef0cd1-a334-4546-a50f-cb208b5751aa\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") "
Jul 21 20:05:16.775870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.775667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq4zc\" (UniqueName: \"kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc\") pod \"24ef0cd1-a334-4546-a50f-cb208b5751aa\" (UID: \"24ef0cd1-a334-4546-a50f-cb208b5751aa\") "
Jul 21 20:05:16.776015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.775995    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24ef0cd1-a334-4546-a50f-cb208b5751aa" (UID: "24ef0cd1-a334-4546-a50f-cb208b5751aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:05:16.777606 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.777578    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc" (OuterVolumeSpecName: "kube-api-access-wq4zc") pod "24ef0cd1-a334-4546-a50f-cb208b5751aa" (UID: "24ef0cd1-a334-4546-a50f-cb208b5751aa"). InnerVolumeSpecName "kube-api-access-wq4zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:05:16.777606 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.777596    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24ef0cd1-a334-4546-a50f-cb208b5751aa" (UID: "24ef0cd1-a334-4546-a50f-cb208b5751aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:05:16.876960 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.876926    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24ef0cd1-a334-4546-a50f-cb208b5751aa-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:16.876960 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.876954    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq4zc\" (UniqueName: \"kubernetes.io/projected/24ef0cd1-a334-4546-a50f-cb208b5751aa-kube-api-access-wq4zc\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:16.876960 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:16.876964    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24ef0cd1-a334-4546-a50f-cb208b5751aa-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:17.578356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.578317    2573 generic.go:356] "Generic (PLEG): container finished" podID="24ef0cd1-a334-4546-a50f-cb208b5751aa" containerID="94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870" exitCode=0
Jul 21 20:05:17.578794 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.578373    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"
Jul 21 20:05:17.578794 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.578391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" event={"ID":"24ef0cd1-a334-4546-a50f-cb208b5751aa","Type":"ContainerDied","Data":"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"}
Jul 21 20:05:17.578794 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.578438    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v" event={"ID":"24ef0cd1-a334-4546-a50f-cb208b5751aa","Type":"ContainerDied","Data":"1fca55652477be3a54d71b9bf278b974be4c108d557ebc57bc9785a275e1e823"}
Jul 21 20:05:17.578794 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.578461    2573 scope.go:117] "RemoveContainer" containerID="94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"
Jul 21 20:05:17.587285 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.587264    2573 scope.go:117] "RemoveContainer" containerID="94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"
Jul 21 20:05:17.587537 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:05:17.587518    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870\": container with ID starting with 94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870 not found: ID does not exist" containerID="94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"
Jul 21 20:05:17.587602 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.587551    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870"} err="failed to get container status \"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870\": rpc error: code = NotFound desc = could not find container \"94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870\": container with ID starting with 94b1a6eba4a76f0b8097d7808c7d84789a8d8bb81abd47a13e1e754aa0d51870 not found: ID does not exist"
Jul 21 20:05:17.599453 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.599430    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:05:17.602322 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:17.602300    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1442c0e7-f6bb7d5bd-sm48v"]
Jul 21 20:05:18.415431 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:18.415398    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ef0cd1-a334-4546-a50f-cb208b5751aa" path="/var/lib/kubelet/pods/24ef0cd1-a334-4546-a50f-cb208b5751aa/volumes"
Jul 21 20:05:21.011697 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.011661    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"]
Jul 21 20:05:21.016779 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.016755    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1442c0e7-nbm82"]
Jul 21 20:05:21.017136 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.017109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:21.154247 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.154215    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:05:21.154449 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.154427    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy" containerID="cri-o://3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4" gracePeriod=30
Jul 21 20:05:21.179392 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.179356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:21.435935 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.435844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:21.691861 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.691772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:21.992085 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992054    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:05:21.992403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992389    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ef0cd1-a334-4546-a50f-cb208b5751aa" containerName="maas-api"
Jul 21 20:05:21.992403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992404    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ef0cd1-a334-4546-a50f-cb208b5751aa" containerName="maas-api"
Jul 21 20:05:21.992524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992431    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf84b72-3830-4c04-85c9-3148525ac7f2" containerName="revoke-keys"
Jul 21 20:05:21.992524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992440    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf84b72-3830-4c04-85c9-3148525ac7f2" containerName="revoke-keys"
Jul 21 20:05:21.992524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992487    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf84b72-3830-4c04-85c9-3148525ac7f2" containerName="revoke-keys"
Jul 21 20:05:21.992524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.992499    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ef0cd1-a334-4546-a50f-cb208b5751aa" containerName="maas-api"
Jul 21 20:05:21.996738 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.996704    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:21.999515 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:21.999493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-163786e6-openshift-default-dockercfg-9r2qs\""
Jul 21 20:05:22.001170 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.001066    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:05:22.010427 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.010354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:22.019891 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.019868    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.019899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.019918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcf89\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.020370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.020225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121217 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121217 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcf89\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121437    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.121860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.121749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.122022 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.122000    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.122098 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.122057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.122212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.122182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.122342 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.122302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.123877 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.123858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.123977 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.123958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.129598 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.129569    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.129870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.129849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcf89\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89\") pod \"e2e-ait-163786e6-openshift-default-6f95f48659-8k28s\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") " pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.311531 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.311452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:22.415606 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.415568    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf84b72-3830-4c04-85c9-3148525ac7f2" path="/var/lib/kubelet/pods/ecf84b72-3830-4c04-85c9-3148525ac7f2/volumes"
Jul 21 20:05:22.424178 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.424141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:22.442541 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.442520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:05:22.444386 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:05:22.444360    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9066639_d46e_4a1e_a651_6691d3e4379d.slice/crio-f22f0bc6105c4e9d0959383bb4eea5db3a6e7afe84d0fd18b1684194fcc65632 WatchSource:0}: Error finding container f22f0bc6105c4e9d0959383bb4eea5db3a6e7afe84d0fd18b1684194fcc65632: Status 404 returned error can't find the container with id f22f0bc6105c4e9d0959383bb4eea5db3a6e7afe84d0fd18b1684194fcc65632
Jul 21 20:05:22.446411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.446377    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:22.446497 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.446444    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:22.446497 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.446491    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:22.604650 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.604549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerStarted","Data":"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"}
Jul 21 20:05:22.604650 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.604611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerStarted","Data":"f22f0bc6105c4e9d0959383bb4eea5db3a6e7afe84d0fd18b1684194fcc65632"}
Jul 21 20:05:22.626275 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:22.626220    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podStartSLOduration=1.626177431 podStartE2EDuration="1.626177431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:05:22.625437593 +0000 UTC m=+1690.338222188" watchObservedRunningTime="2026-07-21 20:05:22.626177431 +0000 UTC m=+1690.338962005"
Jul 21 20:05:23.311635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:23.311596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:23.316772 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:23.316749    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:23.609252 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:23.609167    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:23.610114 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:23.610097    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:24.062148 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.062116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:24.133936 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.133905    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:05:24.137604 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.137582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.137840 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.137810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:24.140414 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.140396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-163786e6-serving-cert\""
Jul 21 20:05:24.150194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.150167    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:05:24.213844 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.213805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:24.239837 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.237861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96ct\" (UniqueName: \"kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.239837 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.237946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.239837 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.237974    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.338470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.338374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96ct\" (UniqueName: \"kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.338470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.338442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.338470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.338460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.339260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.339235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.340921 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.340895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.347340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.347304    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96ct\" (UniqueName: \"kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct\") pod \"maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.382981 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.382920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:24.449702 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.449675    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:24.581494 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.581463    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:05:24.584059 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:05:24.584027    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160a58a0_09a3_4eed_ae70_a6b7b99af9a9.slice/crio-f5089537169ee9f1b0b7670c1bab19410c2b17b6e4ea221ad63fa7c873a44abc WatchSource:0}: Error finding container f5089537169ee9f1b0b7670c1bab19410c2b17b6e4ea221ad63fa7c873a44abc: Status 404 returned error can't find the container with id f5089537169ee9f1b0b7670c1bab19410c2b17b6e4ea221ad63fa7c873a44abc
Jul 21 20:05:24.585403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.585383    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:05:24.615275 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.615245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" event={"ID":"160a58a0-09a3-4eed-ae70-a6b7b99af9a9","Type":"ContainerStarted","Data":"f5089537169ee9f1b0b7670c1bab19410c2b17b6e4ea221ad63fa7c873a44abc"}
Jul 21 20:05:24.701376 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.701341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:24.803125 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:24.803097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:25.621427 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:25.621381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" event={"ID":"160a58a0-09a3-4eed-ae70-a6b7b99af9a9","Type":"ContainerStarted","Data":"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"}
Jul 21 20:05:25.621855 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:25.621590    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:25.656432 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:25.656365    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" podStartSLOduration=1.2635886969999999 podStartE2EDuration="1.656348704s" totalImagesPullingTime="392.760007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:05:25.653984417 +0000 UTC m=+1693.366768990" watchObservedRunningTime="2026-07-21 20:05:25.656348704 +0000 UTC m=+1693.369133310"
Jul 21 20:05:26.404396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.404372    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:05:26.458860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.458860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458828    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.458860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458857    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75dtt\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458881    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458909    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.458961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459024    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459122 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459054    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket\") pod \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\" (UID: \"824683ca-f3dd-47f8-8ef5-97b4bcac8a29\") "
Jul 21 20:05:26.459424 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459280    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:05:26.459424 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459399    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.459538 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459474    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:05:26.459538 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459498    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:05:26.459643 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459600    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:05:26.459983 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.459951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data" (OuterVolumeSpecName: "istio-data") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:05:26.461160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.461128    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt" (OuterVolumeSpecName: "kube-api-access-75dtt") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "kube-api-access-75dtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:05:26.461160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.461143    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token" (OuterVolumeSpecName: "istio-token") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:05:26.461317 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.461300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:05:26.461560 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.461544    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "824683ca-f3dd-47f8-8ef5-97b4bcac8a29" (UID: "824683ca-f3dd-47f8-8ef5-97b4bcac8a29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:05:26.560303 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560268    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560303 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560297    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560303 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560307    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560505 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560316    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560505 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560325    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75dtt\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-kube-api-access-75dtt\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560505 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560334    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560505 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560342    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.560505 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.560349    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/824683ca-f3dd-47f8-8ef5-97b4bcac8a29-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:26.627987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.627956    2573 generic.go:356] "Generic (PLEG): container finished" podID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerID="3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4" exitCode=0
Jul 21 20:05:26.628396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.627996    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"
Jul 21 20:05:26.628396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.628036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerDied","Data":"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"}
Jul 21 20:05:26.628396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.628083    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r" event={"ID":"824683ca-f3dd-47f8-8ef5-97b4bcac8a29","Type":"ContainerDied","Data":"e94e8c909f4df6e3d510a066918f6b47c23ebd56f3ce26220f8dd686a826edeb"}
Jul 21 20:05:26.628396 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.628105    2573 scope.go:117] "RemoveContainer" containerID="3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"
Jul 21 20:05:26.637175 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.637160    2573 scope.go:117] "RemoveContainer" containerID="fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"
Jul 21 20:05:26.645003 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.644985    2573 scope.go:117] "RemoveContainer" containerID="3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"
Jul 21 20:05:26.645265 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:05:26.645244    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4\": container with ID starting with 3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4 not found: ID does not exist" containerID="3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"
Jul 21 20:05:26.645350 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.645277    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4"} err="failed to get container status \"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4\": rpc error: code = NotFound desc = could not find container \"3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4\": container with ID starting with 3b1def9677ae6a2125a4f178dbfda42ba1fc03c56e6b73773e4e2a5b5fe286e4 not found: ID does not exist"
Jul 21 20:05:26.645350 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.645302    2573 scope.go:117] "RemoveContainer" containerID="fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"
Jul 21 20:05:26.645580 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:05:26.645561    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5\": container with ID starting with fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5 not found: ID does not exist" containerID="fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"
Jul 21 20:05:26.645619 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.645587    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5"} err="failed to get container status \"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5\": rpc error: code = NotFound desc = could not find container \"fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5\": container with ID starting with fd3c6262851df836670490274197a8b9bd186678d839168657f864d6113715f5 not found: ID does not exist"
Jul 21 20:05:26.650589 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.650566    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:05:26.654448 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:26.654428    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1442c0e7-gw-openshift-default-7f44db865f-8vp2r"]
Jul 21 20:05:28.414761 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:28.414729    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" path="/var/lib/kubelet/pods/824683ca-f3dd-47f8-8ef5-97b4bcac8a29/volumes"
Jul 21 20:05:31.634520 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:31.634489    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:05:38.611128 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.611091    2573 patch_prober.go:28] interesting pod/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 21 20:05:38.611532 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.611151    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 21 20:05:38.694455 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.694377    2573 generic.go:356] "Generic (PLEG): container finished" podID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerID="4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445" exitCode=0
Jul 21 20:05:38.694599 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.694454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerDied","Data":"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"}
Jul 21 20:05:38.694889 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.694873    2573 scope.go:117] "RemoveContainer" containerID="4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"
Jul 21 20:05:38.695924 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.695891    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:38.696001 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.695982    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:38.696040 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:38.696028    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:05:39.700897 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:39.700860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerStarted","Data":"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"}
Jul 21 20:05:40.312482 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:40.312436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:40.312749 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:40.312701    2573 patch_prober.go:28] interesting pod/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 21 20:05:40.312810 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:40.312790    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 21 20:05:41.312955 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:41.312914    2573 patch_prober.go:28] interesting pod/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 21 20:05:41.313438 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:41.312978    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 21 20:05:42.312837 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:42.312796    2573 patch_prober.go:28] interesting pod/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 21 20:05:42.313028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:42.312857    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 21 20:05:43.312108 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:43.312068    2573 patch_prober.go:28] interesting pod/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 21 20:05:43.312302 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:43.312147    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 21 20:05:44.315883 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:44.315853    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:44.316255 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:44.316141    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:44.316940 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:44.316920    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:05:46.373657 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:46.373614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:46.476069 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:46.476032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:05:49.915415 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915378    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"]
Jul 21 20:05:49.915823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915708    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:05:49.915823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915734    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:05:49.915823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915744    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:05:49.915823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915750    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:05:49.915823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.915800    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:05:49.918752 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.918733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:49.921233 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.921211    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:05:49.926159 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:49.925988    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"]
Jul 21 20:05:50.069319 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.069277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-163786e6-zwgtd\" (UID: \"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:50.170227 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.170134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-163786e6-zwgtd\" (UID: \"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:50.171002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.170979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-163786e6-zwgtd\" (UID: \"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:50.230244 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.230202    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:50.367972 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.367948    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"]
Jul 21 20:05:50.370336 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:05:50.370308    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c45f6b8_e1a3_4d3f_aa3b_579f1c2667de.slice/crio-bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d WatchSource:0}: Error finding container bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d: Status 404 returned error can't find the container with id bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d
Jul 21 20:05:50.753789 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.753737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd" event={"ID":"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de","Type":"ContainerStarted","Data":"713dea1b2b5d2b1bbe1783d96c71214826e7592a98d59f135dfd6a2e6cb874c3"}
Jul 21 20:05:50.753996 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.753808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd" event={"ID":"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de","Type":"ContainerStarted","Data":"bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d"}
Jul 21 20:05:50.770884 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:50.770833    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd" podStartSLOduration=1.770815833 podStartE2EDuration="1.770815833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:05:50.769441233 +0000 UTC m=+1718.482225806" watchObservedRunningTime="2026-07-21 20:05:50.770815833 +0000 UTC m=+1718.483600405"
Jul 21 20:05:51.759795 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:51.759761    2573 generic.go:356] "Generic (PLEG): container finished" podID="3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" containerID="713dea1b2b5d2b1bbe1783d96c71214826e7592a98d59f135dfd6a2e6cb874c3" exitCode=0
Jul 21 20:05:51.760279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:51.759850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd" event={"ID":"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de","Type":"ContainerDied","Data":"713dea1b2b5d2b1bbe1783d96c71214826e7592a98d59f135dfd6a2e6cb874c3"}
Jul 21 20:05:52.896400 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:52.896375    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:52.997858 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:52.997823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca\") pod \"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de\" (UID: \"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de\") "
Jul 21 20:05:52.998221 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:52.998194    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" (UID: "3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:05:53.099366 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:53.099285    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:05:53.770164 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:53.770133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd" event={"ID":"3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de","Type":"ContainerDied","Data":"bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d"}
Jul 21 20:05:53.770164 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:53.770147    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"
Jul 21 20:05:53.770368 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:05:53.770181    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf5589b7574160297b0641982dcf354b24f805373e447788b5783a63eb841d0d"
Jul 21 20:06:00.373068 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.373027    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:06:00.373834 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.373795    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" podUID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" containerName="maas-api" containerID="cri-o://5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208" gracePeriod=30
Jul 21 20:06:00.382497 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.382461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:00.628326 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.628264    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:06:00.780338 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.780305    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca\") pod \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") "
Jul 21 20:06:00.780338 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.780340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q96ct\" (UniqueName: \"kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct\") pod \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") "
Jul 21 20:06:00.780569 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.780396    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls\") pod \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\" (UID: \"160a58a0-09a3-4eed-ae70-a6b7b99af9a9\") "
Jul 21 20:06:00.780678 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.780654    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "160a58a0-09a3-4eed-ae70-a6b7b99af9a9" (UID: "160a58a0-09a3-4eed-ae70-a6b7b99af9a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:06:00.782414 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.782392    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "160a58a0-09a3-4eed-ae70-a6b7b99af9a9" (UID: "160a58a0-09a3-4eed-ae70-a6b7b99af9a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:06:00.782497 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.782475    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct" (OuterVolumeSpecName: "kube-api-access-q96ct") pod "160a58a0-09a3-4eed-ae70-a6b7b99af9a9" (UID: "160a58a0-09a3-4eed-ae70-a6b7b99af9a9"). InnerVolumeSpecName "kube-api-access-q96ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:00.803799 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.803769    2573 generic.go:356] "Generic (PLEG): container finished" podID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" containerID="5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208" exitCode=0
Jul 21 20:06:00.803916 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.803812    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"
Jul 21 20:06:00.803916 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.803855    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" event={"ID":"160a58a0-09a3-4eed-ae70-a6b7b99af9a9","Type":"ContainerDied","Data":"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"}
Jul 21 20:06:00.803916 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.803903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8" event={"ID":"160a58a0-09a3-4eed-ae70-a6b7b99af9a9","Type":"ContainerDied","Data":"f5089537169ee9f1b0b7670c1bab19410c2b17b6e4ea221ad63fa7c873a44abc"}
Jul 21 20:06:00.804032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.803926    2573 scope.go:117] "RemoveContainer" containerID="5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"
Jul 21 20:06:00.812640 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.812622    2573 scope.go:117] "RemoveContainer" containerID="5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"
Jul 21 20:06:00.812897 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:00.812877    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208\": container with ID starting with 5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208 not found: ID does not exist" containerID="5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"
Jul 21 20:06:00.812951 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.812905    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208"} err="failed to get container status \"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208\": rpc error: code = NotFound desc = could not find container \"5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208\": container with ID starting with 5b6b474f3cf62f5e0094da3e7c0f29e59fda0e5d76f74c5ab608d84437aa8208 not found: ID does not exist"
Jul 21 20:06:00.833146 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.833105    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:06:00.834693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.834673    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-163786e6-5cb4c97645-bxqs8"]
Jul 21 20:06:00.881699 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.881634    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:00.881699 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.881659    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:00.881699 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:00.881670    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q96ct\" (UniqueName: \"kubernetes.io/projected/160a58a0-09a3-4eed-ae70-a6b7b99af9a9-kube-api-access-q96ct\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:02.415479 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:02.415446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" path="/var/lib/kubelet/pods/160a58a0-09a3-4eed-ae70-a6b7b99af9a9/volumes"
Jul 21 20:06:04.984737 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:04.982475    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"]
Jul 21 20:06:04.989225 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:04.989171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:04.990230 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:04.990208    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-163786e6-zwgtd"]
Jul 21 20:06:06.253501 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.253468    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:06:06.253932 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.253699    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy" containerID="cri-o://5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5" gracePeriod=30
Jul 21 20:06:06.277163 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.277135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:06.415083 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.415053    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" path="/var/lib/kubelet/pods/3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de/volumes"
Jul 21 20:06:06.517537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.517453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:06.769015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:06.768928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:07.162966 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.162873    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:07.163283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163264    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" containerName="maas-api"
Jul 21 20:06:07.163373 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163285    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" containerName="maas-api"
Jul 21 20:06:07.163373 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163304    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" containerName="revoke-keys"
Jul 21 20:06:07.163373 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163312    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" containerName="revoke-keys"
Jul 21 20:06:07.163517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163384    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c45f6b8-e1a3-4d3f-aa3b-579f1c2667de" containerName="revoke-keys"
Jul 21 20:06:07.163517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163397    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="160a58a0-09a3-4eed-ae70-a6b7b99af9a9" containerName="maas-api"
Jul 21 20:06:07.163517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.163406    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="824683ca-f3dd-47f8-8ef5-97b4bcac8a29" containerName="istio-proxy"
Jul 21 20:06:07.167803 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.167780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.170704 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.170681    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-35ec939f-openshift-default-dockercfg-cwvk7\""
Jul 21 20:06:07.197352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.197328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:07.203032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.202981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:07.234416 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234567 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234567 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234567 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234677 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b6b9\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234677 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234677 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234656    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234798 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.234798 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.234759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.335440 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b6b9\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.335920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.336025    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.336168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.336271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.336445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.336314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.338009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.337986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.338373 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.338355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.344156 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.344128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.344242 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.344159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b6b9\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9\") pod \"e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") " pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.477608 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.477571    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:07.617668 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.617643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:07.619417 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:06:07.619389    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d097a85_02d6_4326_8876_a0bdbb5c761f.slice/crio-7b644f8b2119e0e34c62c8c5daa270cb862d16cf3fcec5a1a408b29ea8eb3c17 WatchSource:0}: Error finding container 7b644f8b2119e0e34c62c8c5daa270cb862d16cf3fcec5a1a408b29ea8eb3c17: Status 404 returned error can't find the container with id 7b644f8b2119e0e34c62c8c5daa270cb862d16cf3fcec5a1a408b29ea8eb3c17
Jul 21 20:06:07.621476 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.621442    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:07.621558 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.621510    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:07.621558 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.621539    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:07.786287 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.786201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:07.840067 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.840015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerStarted","Data":"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"}
Jul 21 20:06:07.840261 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.840080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerStarted","Data":"7b644f8b2119e0e34c62c8c5daa270cb862d16cf3fcec5a1a408b29ea8eb3c17"}
Jul 21 20:06:07.862664 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:07.862610    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podStartSLOduration=0.862594488 podStartE2EDuration="862.594488ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:06:07.86135779 +0000 UTC m=+1735.574142383" watchObservedRunningTime="2026-07-21 20:06:07.862594488 +0000 UTC m=+1735.575379062"
Jul 21 20:06:08.478736 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:08.478686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:08.483515 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:08.483490    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:08.845387 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:08.845307    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:08.846254 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:08.846230    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:09.206198 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.206087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:09.292229 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.292198    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:09.295623 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.295595    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.295835 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.295807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:09.298848 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.298827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-35ec939f-serving-cert\""
Jul 21 20:06:09.305537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.305499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:09.350141 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.350108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.350318 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.350193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmsq\" (UniqueName: \"kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.350318 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.350225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.383150 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.383116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:09.451421 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.451386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmsq\" (UniqueName: \"kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.451421 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.451426    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.451685 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.451477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.451685 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:09.451604    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-serving-cert: secret "maas-api-e2e-derive-35ec939f-serving-cert" not found
Jul 21 20:06:09.451685 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:09.451662    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls podName:91966503-6cfb-4c1e-892b-3a6987f23db3 nodeName:}" failed. No retries permitted until 2026-07-21 20:06:09.951647424 +0000 UTC m=+1737.664431979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls") pod "maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" (UID: "91966503-6cfb-4c1e-892b-3a6987f23db3") : secret "maas-api-e2e-derive-35ec939f-serving-cert" not found
Jul 21 20:06:09.452134 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.452115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.474665 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.474632    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmsq\" (UniqueName: \"kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.855356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.855270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:09.955894 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.955848    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:09.956099 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:09.956015    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-serving-cert: secret "maas-api-e2e-derive-35ec939f-serving-cert" not found
Jul 21 20:06:09.956099 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:09.956096    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls podName:91966503-6cfb-4c1e-892b-3a6987f23db3 nodeName:}" failed. No retries permitted until 2026-07-21 20:06:10.956076449 +0000 UTC m=+1738.668861005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls") pod "maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" (UID: "91966503-6cfb-4c1e-892b-3a6987f23db3") : secret "maas-api-e2e-derive-35ec939f-serving-cert" not found
Jul 21 20:06:09.960693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:09.960665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:10.094964 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:10.094918    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:10.965286 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:10.965253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:10.967972 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:10.967943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:11.110420 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.110383    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:11.243766 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.243740    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:11.495555 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.495497    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:06:11.569861 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569833    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569872    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569889    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569931    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.569960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570020 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570354 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570077    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570354 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570107    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcf89\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89\") pod \"f9066639-d46e-4a1e-a651-6691d3e4379d\" (UID: \"f9066639-d46e-4a1e-a651-6691d3e4379d\") "
Jul 21 20:06:11.570354 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:11.570354 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570203    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:11.570581 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570392    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:11.570581 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570431    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.570581 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570450    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.570770 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.570744    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:06:11.571027 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.571009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:11.572203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.572178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:11.572203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.572182    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:11.572470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.572447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:06:11.572566 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.572453    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89" (OuterVolumeSpecName: "kube-api-access-rcf89") pod "f9066639-d46e-4a1e-a651-6691d3e4379d" (UID: "f9066639-d46e-4a1e-a651-6691d3e4379d"). InnerVolumeSpecName "kube-api-access-rcf89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:11.671893 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671864    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671898    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671912    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9066639-d46e-4a1e-a651-6691d3e4379d-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671926    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671937    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671950    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9066639-d46e-4a1e-a651-6691d3e4379d-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.672019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.671963    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcf89\" (UniqueName: \"kubernetes.io/projected/f9066639-d46e-4a1e-a651-6691d3e4379d-kube-api-access-rcf89\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:11.861174 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.861090    2573 generic.go:356] "Generic (PLEG): container finished" podID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerID="5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5" exitCode=0
Jul 21 20:06:11.861174 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.861138    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"
Jul 21 20:06:11.861413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.861169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerDied","Data":"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"}
Jul 21 20:06:11.861413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.861229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s" event={"ID":"f9066639-d46e-4a1e-a651-6691d3e4379d","Type":"ContainerDied","Data":"f22f0bc6105c4e9d0959383bb4eea5db3a6e7afe84d0fd18b1684194fcc65632"}
Jul 21 20:06:11.861413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.861254    2573 scope.go:117] "RemoveContainer" containerID="5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"
Jul 21 20:06:11.862983 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.862950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" event={"ID":"91966503-6cfb-4c1e-892b-3a6987f23db3","Type":"ContainerStarted","Data":"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"}
Jul 21 20:06:11.863099 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.862993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" event={"ID":"91966503-6cfb-4c1e-892b-3a6987f23db3","Type":"ContainerStarted","Data":"9b3fa770697f4786b421fb0e52bdf216ad7e392400ccbd1655a9f3bb8f763e9c"}
Jul 21 20:06:11.863158 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.863098    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:11.870665 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.870649    2573 scope.go:117] "RemoveContainer" containerID="4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"
Jul 21 20:06:11.878183 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.878167    2573 scope.go:117] "RemoveContainer" containerID="5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"
Jul 21 20:06:11.878412 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:11.878394    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5\": container with ID starting with 5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5 not found: ID does not exist" containerID="5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"
Jul 21 20:06:11.878451 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.878422    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5"} err="failed to get container status \"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5\": rpc error: code = NotFound desc = could not find container \"5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5\": container with ID starting with 5ea55a90c0eea5e7be55b64503b69b46e6379be2c41fe1348a5de0cc844faee5 not found: ID does not exist"
Jul 21 20:06:11.878451 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.878445    2573 scope.go:117] "RemoveContainer" containerID="4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"
Jul 21 20:06:11.878666 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:11.878649    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445\": container with ID starting with 4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445 not found: ID does not exist" containerID="4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"
Jul 21 20:06:11.878702 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.878671    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445"} err="failed to get container status \"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445\": rpc error: code = NotFound desc = could not find container \"4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445\": container with ID starting with 4953c652a5216e724b4249cecd8d4c311579a58b978aedddd9c4f5422ade0445 not found: ID does not exist"
Jul 21 20:06:11.883684 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.883646    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" podStartSLOduration=2.475706775 podStartE2EDuration="2.88363418s" totalImagesPullingTime="407.927405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:06:11.883173185 +0000 UTC m=+1739.595957758" watchObservedRunningTime="2026-07-21 20:06:11.88363418 +0000 UTC m=+1739.596418864"
Jul 21 20:06:11.896469 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.896443    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:06:11.902866 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:11.902846    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-163786e6-openshift-default-6f95f48659-8k28s"]
Jul 21 20:06:12.415165 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:12.415131    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" path="/var/lib/kubelet/pods/f9066639-d46e-4a1e-a651-6691d3e4379d/volumes"
Jul 21 20:06:17.875023 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:17.874995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:20.666332 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:20.666289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:20.765663 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:20.765623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:22.918287 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.918210    2573 generic.go:356] "Generic (PLEG): container finished" podID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerID="b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0" exitCode=0
Jul 21 20:06:22.918684 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.918287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerDied","Data":"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"}
Jul 21 20:06:22.918684 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.918674    2573 scope.go:117] "RemoveContainer" containerID="b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"
Jul 21 20:06:22.919629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.919604    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:22.919697 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.919667    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:22.919756 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:22.919703    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:06:23.846317 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:23.846249    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:23.924408 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:23.924368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerStarted","Data":"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"}
Jul 21 20:06:24.478499 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:24.478468    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:24.479726 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:24.479687    2573 patch_prober.go:28] interesting pod/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 20:06:24.479850 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:24.479766    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 20:06:25.478602 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:25.478564    2573 patch_prober.go:28] interesting pod/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 20:06:25.479021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:25.478638    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 20:06:26.478132 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:26.478088    2573 patch_prober.go:28] interesting pod/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 20:06:26.478310 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:26.478153    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 20:06:27.478162 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:27.478125    2573 patch_prober.go:28] interesting pod/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 21 20:06:27.478552 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:27.478193    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 21 20:06:28.481631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:28.481600    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:28.482006 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:28.481959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:28.482674 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:28.482658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:30.630231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:30.630187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:30.732834 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:30.732797    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:34.160161 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160124    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"]
Jul 21 20:06:34.160542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160438    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:06:34.160542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160448    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:06:34.160542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160459    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:06:34.160542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160465    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:06:34.160542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.160525    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:06:34.162759 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.162743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:34.165234 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.165209    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:06:34.171419 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.171395    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"]
Jul 21 20:06:34.275230 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.275193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd\" (UID: \"9e0ecb05-ddce-4d40-99fe-265d59593b52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:34.376709 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.376668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd\" (UID: \"9e0ecb05-ddce-4d40-99fe-265d59593b52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:34.377310 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.377287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd\" (UID: \"9e0ecb05-ddce-4d40-99fe-265d59593b52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:34.475172 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.475139    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:34.610834 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.610779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"]
Jul 21 20:06:34.613083 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:06:34.613053    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0ecb05_ddce_4d40_99fe_265d59593b52.slice/crio-e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137 WatchSource:0}: Error finding container e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137: Status 404 returned error can't find the container with id e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137
Jul 21 20:06:34.977516 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.977474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd" event={"ID":"9e0ecb05-ddce-4d40-99fe-265d59593b52","Type":"ContainerStarted","Data":"a86c0907c99b85fd4002dadcb4c40bcdb7d3934867f6d76e85d85c12ab388b7e"}
Jul 21 20:06:34.977688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.977565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd" event={"ID":"9e0ecb05-ddce-4d40-99fe-265d59593b52","Type":"ContainerStarted","Data":"e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137"}
Jul 21 20:06:34.994054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:34.993999    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd" podStartSLOduration=0.993983088 podStartE2EDuration="993.983088ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:06:34.992583682 +0000 UTC m=+1762.705368255" watchObservedRunningTime="2026-07-21 20:06:34.993983088 +0000 UTC m=+1762.706767660"
Jul 21 20:06:35.983640 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:35.983604    2573 generic.go:356] "Generic (PLEG): container finished" podID="9e0ecb05-ddce-4d40-99fe-265d59593b52" containerID="a86c0907c99b85fd4002dadcb4c40bcdb7d3934867f6d76e85d85c12ab388b7e" exitCode=0
Jul 21 20:06:35.984045 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:35.983687    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd" event={"ID":"9e0ecb05-ddce-4d40-99fe-265d59593b52","Type":"ContainerDied","Data":"a86c0907c99b85fd4002dadcb4c40bcdb7d3934867f6d76e85d85c12ab388b7e"}
Jul 21 20:06:37.114595 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.114571    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:37.209288 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.209246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca\") pod \"9e0ecb05-ddce-4d40-99fe-265d59593b52\" (UID: \"9e0ecb05-ddce-4d40-99fe-265d59593b52\") "
Jul 21 20:06:37.209608 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.209584    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e0ecb05-ddce-4d40-99fe-265d59593b52" (UID: "9e0ecb05-ddce-4d40-99fe-265d59593b52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:06:37.310320 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.310236    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e0ecb05-ddce-4d40-99fe-265d59593b52-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:37.993398 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.993349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd" event={"ID":"9e0ecb05-ddce-4d40-99fe-265d59593b52","Type":"ContainerDied","Data":"e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137"}
Jul 21 20:06:37.993574 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.993412    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5e5c66e5995e3a26b82e7f119561a100010dad2711620297e2444140af8f137"
Jul 21 20:06:37.993574 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:37.993372    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"
Jul 21 20:06:44.508055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.508021    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:44.508494 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.508225    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" podUID="91966503-6cfb-4c1e-892b-3a6987f23db3" containerName="maas-api" containerID="cri-o://e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0" gracePeriod=30
Jul 21 20:06:44.535086 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.535057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:44.756609 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.756584    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:44.874774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.874671    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca\") pod \"91966503-6cfb-4c1e-892b-3a6987f23db3\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") "
Jul 21 20:06:44.874774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.874754    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzmsq\" (UniqueName: \"kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq\") pod \"91966503-6cfb-4c1e-892b-3a6987f23db3\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") "
Jul 21 20:06:44.874953 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.874791    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") pod \"91966503-6cfb-4c1e-892b-3a6987f23db3\" (UID: \"91966503-6cfb-4c1e-892b-3a6987f23db3\") "
Jul 21 20:06:44.875114 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.875082    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91966503-6cfb-4c1e-892b-3a6987f23db3" (UID: "91966503-6cfb-4c1e-892b-3a6987f23db3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:06:44.876857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.876827    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq" (OuterVolumeSpecName: "kube-api-access-hzmsq") pod "91966503-6cfb-4c1e-892b-3a6987f23db3" (UID: "91966503-6cfb-4c1e-892b-3a6987f23db3"). InnerVolumeSpecName "kube-api-access-hzmsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:44.876975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.876937    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91966503-6cfb-4c1e-892b-3a6987f23db3" (UID: "91966503-6cfb-4c1e-892b-3a6987f23db3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:06:44.976211 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.976177    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzmsq\" (UniqueName: \"kubernetes.io/projected/91966503-6cfb-4c1e-892b-3a6987f23db3-kube-api-access-hzmsq\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:44.976211 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.976206    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91966503-6cfb-4c1e-892b-3a6987f23db3-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:44.976393 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:44.976221    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91966503-6cfb-4c1e-892b-3a6987f23db3-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:45.027176 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.027138    2573 generic.go:356] "Generic (PLEG): container finished" podID="91966503-6cfb-4c1e-892b-3a6987f23db3" containerID="e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0" exitCode=0
Jul 21 20:06:45.027364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.027187    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"
Jul 21 20:06:45.027364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.027192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" event={"ID":"91966503-6cfb-4c1e-892b-3a6987f23db3","Type":"ContainerDied","Data":"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"}
Jul 21 20:06:45.027364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.027318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx" event={"ID":"91966503-6cfb-4c1e-892b-3a6987f23db3","Type":"ContainerDied","Data":"9b3fa770697f4786b421fb0e52bdf216ad7e392400ccbd1655a9f3bb8f763e9c"}
Jul 21 20:06:45.027364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.027347    2573 scope.go:117] "RemoveContainer" containerID="e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"
Jul 21 20:06:45.036799 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.036779    2573 scope.go:117] "RemoveContainer" containerID="e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"
Jul 21 20:06:45.037076 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:45.037056    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0\": container with ID starting with e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0 not found: ID does not exist" containerID="e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"
Jul 21 20:06:45.037148 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.037090    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0"} err="failed to get container status \"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0\": rpc error: code = NotFound desc = could not find container \"e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0\": container with ID starting with e3648f03ed34356b33706eaaa0b2edbde18fb6fd7ac029ca3342d167cdb72ea0 not found: ID does not exist"
Jul 21 20:06:45.051789 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.051761    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:45.054360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:45.054339    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35ec939f-79745d6d85-fsvzx"]
Jul 21 20:06:46.414612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:46.414581    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91966503-6cfb-4c1e-892b-3a6987f23db3" path="/var/lib/kubelet/pods/91966503-6cfb-4c1e-892b-3a6987f23db3/volumes"
Jul 21 20:06:49.220144 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.220103    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"]
Jul 21 20:06:49.222573 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.222544    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35ec939f-jr6vd"]
Jul 21 20:06:49.225101 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.225068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:49.368467 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.368432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:49.368702 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.368677    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy" containerID="cri-o://853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b" gracePeriod=30
Jul 21 20:06:49.396130 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.396100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:49.636925 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:49.636834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:50.152255 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:50.152221    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:50.251055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:50.251024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:50.352521 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:50.352469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:50.414762 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:50.414671    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0ecb05-ddce-4d40-99fe-265d59593b52" path="/var/lib/kubelet/pods/9e0ecb05-ddce-4d40-99fe-265d59593b52/volumes"
Jul 21 20:06:51.869705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:51.869671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:54.616353 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.616329    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:54.763440 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763413    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763446    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763489    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763526    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763552    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b6b9\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763618 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763584    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763971 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763647    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763971 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert\") pod \"4d097a85-02d6-4326-8876-a0bdbb5c761f\" (UID: \"4d097a85-02d6-4326-8876-a0bdbb5c761f\") "
Jul 21 20:06:54.763971 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763796    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:54.763971 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763909    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:54.763971 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.763939    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:54.764214 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.764081    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.764214 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.764101    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.764214 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.764116    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.764214 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.764110    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:06:54.764421 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.764343    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:54.765815 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.765783    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:54.765936 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.765825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9" (OuterVolumeSpecName: "kube-api-access-8b6b9") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "kube-api-access-8b6b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:06:54.766002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.765959    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:06:54.766002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.765990    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d097a85-02d6-4326-8876-a0bdbb5c761f" (UID: "4d097a85-02d6-4326-8876-a0bdbb5c761f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:06:54.865345 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865311    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.865345 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865338    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.865345 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865347    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.865575 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865355    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d097a85-02d6-4326-8876-a0bdbb5c761f-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.865575 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865364    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b6b9\" (UniqueName: \"kubernetes.io/projected/4d097a85-02d6-4326-8876-a0bdbb5c761f-kube-api-access-8b6b9\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:54.865575 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:54.865374    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d097a85-02d6-4326-8876-a0bdbb5c761f-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:06:55.076483 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.076401    2573 generic.go:356] "Generic (PLEG): container finished" podID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerID="853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b" exitCode=0
Jul 21 20:06:55.076483 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.076447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerDied","Data":"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"}
Jul 21 20:06:55.076483 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.076486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4" event={"ID":"4d097a85-02d6-4326-8876-a0bdbb5c761f","Type":"ContainerDied","Data":"7b644f8b2119e0e34c62c8c5daa270cb862d16cf3fcec5a1a408b29ea8eb3c17"}
Jul 21 20:06:55.076739 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.076505    2573 scope.go:117] "RemoveContainer" containerID="853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"
Jul 21 20:06:55.076739 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.076450    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"
Jul 21 20:06:55.085648 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.085630    2573 scope.go:117] "RemoveContainer" containerID="b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"
Jul 21 20:06:55.095631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.095612    2573 scope.go:117] "RemoveContainer" containerID="853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"
Jul 21 20:06:55.095929 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:55.095906    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b\": container with ID starting with 853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b not found: ID does not exist" containerID="853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"
Jul 21 20:06:55.096044 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.095935    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b"} err="failed to get container status \"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b\": rpc error: code = NotFound desc = could not find container \"853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b\": container with ID starting with 853e07dd86b4479968270eb7bd427faefccf2d12f5f92d34c021ea078ad4354b not found: ID does not exist"
Jul 21 20:06:55.096044 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.095953    2573 scope.go:117] "RemoveContainer" containerID="b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"
Jul 21 20:06:55.096186 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:06:55.096168    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0\": container with ID starting with b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0 not found: ID does not exist" containerID="b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"
Jul 21 20:06:55.096242 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.096190    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0"} err="failed to get container status \"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0\": rpc error: code = NotFound desc = could not find container \"b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0\": container with ID starting with b6a7fa6eaa45daaab0c00b35920812842bff525cdc8f267c32ac403b623ef0a0 not found: ID does not exist"
Jul 21 20:06:55.099049 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.099026    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:55.102655 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:55.102635    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-35ec939f-openshift-default-df9cfd855-khsq4"]
Jul 21 20:06:56.414562 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:56.414528    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" path="/var/lib/kubelet/pods/4d097a85-02d6-4326-8876-a0bdbb5c761f/volumes"
Jul 21 20:06:57.610840 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:57.610808    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:57.718294 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:57.718251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:57.813607 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:57.813569    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:57.912521 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:57.912438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:06:58.382090 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:06:58.382045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:22.913507 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:22.913463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:22.966841 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:22.966805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:24.415899 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:24.415864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:30.777813 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:30.777776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:30.884638 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:30.884605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:30.976524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:30.976482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:46.924300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:46.924259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:52.831859 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:52.831825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:52.896110 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:52.896078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:52.995394 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:52.995366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:07:53.084132 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:07:53.084053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:03.640393 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:03.640353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:04.471903 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:04.471866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:10.564106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:10.564072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:10.634285 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:10.634242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:10.726822 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:10.726778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:10.830195 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:10.830102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:10.926915 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:10.926883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:11.763165 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:11.763130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:11.865907 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:11.865874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:11.960053 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:11.960015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:18.820986 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:18.820951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:24.907053 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:24.906993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:25.007276 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:25.007240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:25.624033 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:25.624000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:31.438102 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.438063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:31.538541 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.538504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:31.652080 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.652045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:31.957016 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.956982    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:08:31.957365 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957348    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957367    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957382    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0ecb05-ddce-4d40-99fe-265d59593b52" containerName="revoke-keys"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957392    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0ecb05-ddce-4d40-99fe-265d59593b52" containerName="revoke-keys"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957403    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957412    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957428    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91966503-6cfb-4c1e-892b-3a6987f23db3" containerName="maas-api"
Jul 21 20:08:31.957446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957437    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="91966503-6cfb-4c1e-892b-3a6987f23db3" containerName="maas-api"
Jul 21 20:08:31.958091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957539    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0ecb05-ddce-4d40-99fe-265d59593b52" containerName="revoke-keys"
Jul 21 20:08:31.958091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957552    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9066639-d46e-4a1e-a651-6691d3e4379d" containerName="istio-proxy"
Jul 21 20:08:31.958091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957564    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.958091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957573    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="91966503-6cfb-4c1e-892b-3a6987f23db3" containerName="maas-api"
Jul 21 20:08:31.958091 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.957583    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d097a85-02d6-4326-8876-a0bdbb5c761f" containerName="istio-proxy"
Jul 21 20:08:31.960670 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.960650    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:31.963470 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.963449    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-43a9f608-openshift-default-dockercfg-gnzqx\""
Jul 21 20:08:31.984127 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.984097    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:08:31.994242 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:31.994210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:32.054319 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054319 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prfcn\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054814 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.054814 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.054699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.155969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156013    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156465 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156534 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prfcn\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156590 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156590 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.156675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.157018 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.156996    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.157121 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.157099    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.157229 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.157213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.158996 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.158961    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.159259 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.159238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.168853 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.168819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:32.170124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.170101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.171571 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.171551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prfcn\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn\") pod \"e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") " pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.271489 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.271454    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:32.405233 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.405208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:08:32.406746 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:08:32.406703    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf910ee_ef93_44cf_9dab_7518c60bc361.slice/crio-0fe529e512100973ae95df3183ad5c701720326759708dda0a8fc8037f85db1b WatchSource:0}: Error finding container 0fe529e512100973ae95df3183ad5c701720326759708dda0a8fc8037f85db1b: Status 404 returned error can't find the container with id 0fe529e512100973ae95df3183ad5c701720326759708dda0a8fc8037f85db1b
Jul 21 20:08:32.408674 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.408645    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:32.408748 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.408703    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:32.408796 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.408754    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:32.521411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.521370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerStarted","Data":"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"}
Jul 21 20:08:32.521848 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.521428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerStarted","Data":"0fe529e512100973ae95df3183ad5c701720326759708dda0a8fc8037f85db1b"}
Jul 21 20:08:32.543541 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:32.543481    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podStartSLOduration=1.543458461 podStartE2EDuration="1.543458461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:08:32.542364306 +0000 UTC m=+1880.255148879" watchObservedRunningTime="2026-07-21 20:08:32.543458461 +0000 UTC m=+1880.256243034"
Jul 21 20:08:33.271990 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:33.271950    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:33.276740 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:33.276697    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:33.526079 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:33.525992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:33.527055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:33.527017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:34.880661 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.880576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:34.950653 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.950615    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:34.954563 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.954535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:34.957359 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.957332    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-43a9f608-serving-cert\""
Jul 21 20:08:34.966535 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.966505    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:34.967038 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:34.966992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:35.033248 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.033218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:35.084544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.084508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77sw\" (UniqueName: \"kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.084750 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.084559    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.084750 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.084654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.185477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.185400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77sw\" (UniqueName: \"kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.185477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.185442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.185477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.185472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.185692 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:08:35.185571    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-serving-cert: secret "maas-api-e2e-mt-43a9f608-serving-cert" not found
Jul 21 20:08:35.185692 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:08:35.185635    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls podName:8d6a073c-2b24-4a80-80a6-b1a01f7bbbba nodeName:}" failed. No retries permitted until 2026-07-21 20:08:35.685619506 +0000 UTC m=+1883.398404057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls") pod "maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" (UID: "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba") : secret "maas-api-e2e-mt-43a9f608-serving-cert" not found
Jul 21 20:08:35.186110 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.186090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.196672 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.196645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77sw\" (UniqueName: \"kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.419382 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.419341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:35.519342 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.519307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:35.689641 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.689610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.692117 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.692093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") pod \"maas-api-e2e-mt-43a9f608-7f859ff667-t9w25\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:35.868905 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:35.868815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:36.002959 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:36.002932    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:36.005068 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:08:36.005033    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6a073c_2b24_4a80_80a6_b1a01f7bbbba.slice/crio-0edfa4ac6025f16b162c0ec2c2877497f15155e4ac551d955851a9dc17abad43 WatchSource:0}: Error finding container 0edfa4ac6025f16b162c0ec2c2877497f15155e4ac551d955851a9dc17abad43: Status 404 returned error can't find the container with id 0edfa4ac6025f16b162c0ec2c2877497f15155e4ac551d955851a9dc17abad43
Jul 21 20:08:36.545238 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:36.545201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" event={"ID":"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba","Type":"ContainerStarted","Data":"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"}
Jul 21 20:08:36.545434 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:36.545257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" event={"ID":"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba","Type":"ContainerStarted","Data":"0edfa4ac6025f16b162c0ec2c2877497f15155e4ac551d955851a9dc17abad43"}
Jul 21 20:08:36.545434 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:36.545285    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:36.561551 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:36.561499    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" podStartSLOduration=2.138707906 podStartE2EDuration="2.561479938s" totalImagesPullingTime="422.772032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:08:36.5608138 +0000 UTC m=+1884.273598396" watchObservedRunningTime="2026-07-21 20:08:36.561479938 +0000 UTC m=+1884.274264510"
Jul 21 20:08:39.420617 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:39.420576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:40.115621 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:40.115582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:40.251900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:40.251860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:40.607601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:40.607565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:42.561844 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:42.561802    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:46.257357 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.257304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:46.357271 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.357229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:46.631632 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.631550    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"]
Jul 21 20:08:46.635019 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.634982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:46.637592 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.637569    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:08:46.642162 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.642138    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"]
Jul 21 20:08:46.799237 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.799190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx\" (UID: \"792d5c35-8e9a-4bc5-afaf-0ebc010299a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:46.900303 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.900206    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx\" (UID: \"792d5c35-8e9a-4bc5-afaf-0ebc010299a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:46.900879 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.900859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx\" (UID: \"792d5c35-8e9a-4bc5-afaf-0ebc010299a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:46.948263 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:46.948229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:47.098815 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:47.098791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"]
Jul 21 20:08:47.101157 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:08:47.101130    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792d5c35_8e9a_4bc5_afaf_0ebc010299a2.slice/crio-18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b WatchSource:0}: Error finding container 18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b: Status 404 returned error can't find the container with id 18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b
Jul 21 20:08:47.599102 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:47.599021    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx" event={"ID":"792d5c35-8e9a-4bc5-afaf-0ebc010299a2","Type":"ContainerStarted","Data":"1e64356ac104daa3fd96f08ae941e91859aee6b63ef63b4953ae52dd3e513707"}
Jul 21 20:08:47.599102 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:47.599073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx" event={"ID":"792d5c35-8e9a-4bc5-afaf-0ebc010299a2","Type":"ContainerStarted","Data":"18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b"}
Jul 21 20:08:47.616039 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:47.615983    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx" podStartSLOduration=1.6159675679999999 podStartE2EDuration="1.615967568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:08:47.614334216 +0000 UTC m=+1895.327118799" watchObservedRunningTime="2026-07-21 20:08:47.615967568 +0000 UTC m=+1895.328752140"
Jul 21 20:08:48.528098 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.528067    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 20:08:48.528319 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.528117    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 20:08:48.604939 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.604903    2573 generic.go:356] "Generic (PLEG): container finished" podID="792d5c35-8e9a-4bc5-afaf-0ebc010299a2" containerID="1e64356ac104daa3fd96f08ae941e91859aee6b63ef63b4953ae52dd3e513707" exitCode=0
Jul 21 20:08:48.605370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.604978    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx" event={"ID":"792d5c35-8e9a-4bc5-afaf-0ebc010299a2","Type":"ContainerDied","Data":"1e64356ac104daa3fd96f08ae941e91859aee6b63ef63b4953ae52dd3e513707"}
Jul 21 20:08:48.606513 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.606489    2573 generic.go:356] "Generic (PLEG): container finished" podID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerID="62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475" exitCode=0
Jul 21 20:08:48.606624 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.606547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerDied","Data":"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"}
Jul 21 20:08:48.607043 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.607008    2573 scope.go:117] "RemoveContainer" containerID="62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"
Jul 21 20:08:48.608110 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.608078    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:48.608187 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.608170    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:48.608252 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:48.608236    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:08:49.618958 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:49.618919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerStarted","Data":"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"}
Jul 21 20:08:49.784961 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:49.784931    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:49.824544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:49.824514    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca\") pod \"792d5c35-8e9a-4bc5-afaf-0ebc010299a2\" (UID: \"792d5c35-8e9a-4bc5-afaf-0ebc010299a2\") "
Jul 21 20:08:49.824870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:49.824846    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "792d5c35-8e9a-4bc5-afaf-0ebc010299a2" (UID: "792d5c35-8e9a-4bc5-afaf-0ebc010299a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:08:49.925273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:49.925186    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792d5c35-8e9a-4bc5-afaf-0ebc010299a2-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:08:50.272006 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.271962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:50.272240 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.272214    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 20:08:50.272292 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.272268    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 20:08:50.629085 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.628998    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"
Jul 21 20:08:50.629085 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.629044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx" event={"ID":"792d5c35-8e9a-4bc5-afaf-0ebc010299a2","Type":"ContainerDied","Data":"18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b"}
Jul 21 20:08:50.629512 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:50.629094    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18f58f56a6bd1ed2a3c5153d50209630d19ee864d50c6afb18e7c166e83f2f2b"
Jul 21 20:08:51.272408 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:51.272364    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 20:08:51.272599 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:51.272429    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 20:08:52.272972 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:52.272932    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 20:08:52.273403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:52.272994    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 20:08:53.272102 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:53.272058    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 21 20:08:53.272288 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:53.272132    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 21 20:08:54.276540 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:54.276510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:54.276943 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:54.276771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:54.277536 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:54.277517    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:08:57.131595 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.131561    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:57.132004 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.131810    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" podUID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" containerName="maas-api" containerID="cri-o://62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d" gracePeriod=30
Jul 21 20:08:57.158267 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.158233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:08:57.378896 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.378869    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:57.498001 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.497968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c77sw\" (UniqueName: \"kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw\") pod \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") "
Jul 21 20:08:57.498169 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.498019    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") pod \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") "
Jul 21 20:08:57.498169 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.498069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca\") pod \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\" (UID: \"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba\") "
Jul 21 20:08:57.498513 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.498488    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" (UID: "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:08:57.500210 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.500184    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw" (OuterVolumeSpecName: "kube-api-access-c77sw") pod "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" (UID: "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba"). InnerVolumeSpecName "kube-api-access-c77sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:08:57.500315 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.500290    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" (UID: "8d6a073c-2b24-4a80-80a6-b1a01f7bbbba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:08:57.598780 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.598742    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:08:57.598780 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.598772    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c77sw\" (UniqueName: \"kubernetes.io/projected/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-kube-api-access-c77sw\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:08:57.598780 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.598782    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:08:57.664704 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.664669    2573 generic.go:356] "Generic (PLEG): container finished" podID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" containerID="62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d" exitCode=0
Jul 21 20:08:57.664895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.664730    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"
Jul 21 20:08:57.664895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.664740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" event={"ID":"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba","Type":"ContainerDied","Data":"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"}
Jul 21 20:08:57.664895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.664782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25" event={"ID":"8d6a073c-2b24-4a80-80a6-b1a01f7bbbba","Type":"ContainerDied","Data":"0edfa4ac6025f16b162c0ec2c2877497f15155e4ac551d955851a9dc17abad43"}
Jul 21 20:08:57.664895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.664808    2573 scope.go:117] "RemoveContainer" containerID="62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"
Jul 21 20:08:57.674224 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.674205    2573 scope.go:117] "RemoveContainer" containerID="62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"
Jul 21 20:08:57.674495 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:08:57.674473    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d\": container with ID starting with 62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d not found: ID does not exist" containerID="62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"
Jul 21 20:08:57.674550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.674506    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d"} err="failed to get container status \"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d\": rpc error: code = NotFound desc = could not find container \"62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d\": container with ID starting with 62358f926a348b14aadbbafed13a6bfa7edbb9bc78b7c4ce936bb1bfe6e1187d not found: ID does not exist"
Jul 21 20:08:57.686015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.685979    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:57.691967 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:57.691941    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43a9f608-7f859ff667-t9w25"]
Jul 21 20:08:58.415194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:08:58.415161    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" path="/var/lib/kubelet/pods/8d6a073c-2b24-4a80-80a6-b1a01f7bbbba/volumes"
Jul 21 20:09:01.693637 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:01.693602    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"]
Jul 21 20:09:01.696520 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:01.696489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:01.696651 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:01.696515    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-43a9f608-jjzsx"]
Jul 21 20:09:02.112580 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:02.112544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:02.416038 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:02.415959    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792d5c35-8e9a-4bc5-afaf-0ebc010299a2" path="/var/lib/kubelet/pods/792d5c35-8e9a-4bc5-afaf-0ebc010299a2/volumes"
Jul 21 20:09:07.747650 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:07.747610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:07.847932 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:07.847898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:08.041138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.041057    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:09:08.041296 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.041258    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" containerID="cri-o://fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48" gracePeriod=30
Jul 21 20:09:08.072529 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.072502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:08.309742 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.309642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:08.437644 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.437604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:08.536435 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.536407    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:08.648282 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:08.648197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:09.279095 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:09.279046    2573 patch_prober.go:28] interesting pod/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 20:09:09.279474 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:09.279124    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:09:13.293778 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.293752    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:09:13.444169 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444079    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444169 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444215    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444246    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444299    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prfcn\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444322    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444354    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert\") pod \"acf910ee-ef93-44cf-9dab-7518c60bc361\" (UID: \"acf910ee-ef93-44cf-9dab-7518c60bc361\") "
Jul 21 20:09:13.444760 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444467    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:09:13.444760 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444561    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:09:13.444760 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444551    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:09:13.444934 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444825    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.444934 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444848    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.444934 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444867    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.444934 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444915    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:09:13.445144 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.444995    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data" (OuterVolumeSpecName: "istio-data") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:09:13.446668 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.446648    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:09:13.446789 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.446686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:09:13.446945 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.446927    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token" (OuterVolumeSpecName: "istio-token") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:09:13.446993 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.446928    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn" (OuterVolumeSpecName: "kube-api-access-prfcn") pod "acf910ee-ef93-44cf-9dab-7518c60bc361" (UID: "acf910ee-ef93-44cf-9dab-7518c60bc361"). InnerVolumeSpecName "kube-api-access-prfcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:09:13.546139 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546107    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.546139 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546140    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.546335 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546152    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prfcn\" (UniqueName: \"kubernetes.io/projected/acf910ee-ef93-44cf-9dab-7518c60bc361-kube-api-access-prfcn\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.546335 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546165    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.546335 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546176    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acf910ee-ef93-44cf-9dab-7518c60bc361-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.546335 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.546185    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acf910ee-ef93-44cf-9dab-7518c60bc361-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:09:13.739569 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.739536    2573 generic.go:356] "Generic (PLEG): container finished" podID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerID="fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48" exitCode=0
Jul 21 20:09:13.739759 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.739577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerDied","Data":"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"}
Jul 21 20:09:13.739759 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.739615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd" event={"ID":"acf910ee-ef93-44cf-9dab-7518c60bc361","Type":"ContainerDied","Data":"0fe529e512100973ae95df3183ad5c701720326759708dda0a8fc8037f85db1b"}
Jul 21 20:09:13.739759 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.739641    2573 scope.go:117] "RemoveContainer" containerID="fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"
Jul 21 20:09:13.739759 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.739580    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"
Jul 21 20:09:13.754704 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.754681    2573 scope.go:117] "RemoveContainer" containerID="62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"
Jul 21 20:09:13.762491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.762472    2573 scope.go:117] "RemoveContainer" containerID="fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"
Jul 21 20:09:13.762866 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:09:13.762836    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48\": container with ID starting with fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48 not found: ID does not exist" containerID="fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"
Jul 21 20:09:13.763047 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.762876    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48"} err="failed to get container status \"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48\": rpc error: code = NotFound desc = could not find container \"fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48\": container with ID starting with fa61222b4775677937dbf6cc93acd143f81534e9505ea9d959571cdd0077cf48 not found: ID does not exist"
Jul 21 20:09:13.763047 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.762900    2573 scope.go:117] "RemoveContainer" containerID="62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"
Jul 21 20:09:13.763261 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:09:13.763238    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475\": container with ID starting with 62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475 not found: ID does not exist" containerID="62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"
Jul 21 20:09:13.763408 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.763269    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475"} err="failed to get container status \"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475\": rpc error: code = NotFound desc = could not find container \"62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475\": container with ID starting with 62d91f8e65833873f79528ec4f655882db2733a75388ef9349d9af88f3722475 not found: ID does not exist"
Jul 21 20:09:13.765194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.765168    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:09:13.768782 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:13.768759    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-43a9f608-openshift-default-6d7546999f-q4ljd"]
Jul 21 20:09:14.289203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.289167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:14.353543 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.353514    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:14.415935 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.415901    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" path="/var/lib/kubelet/pods/acf910ee-ef93-44cf-9dab-7518c60bc361/volumes"
Jul 21 20:09:14.437248 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.437212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:14.538012 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.537974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:14.642918 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:14.642832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:20.273459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:20.273422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:20.373261 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:20.373225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:27.160629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.160593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:27.463302 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463221    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:09:27.463542 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463530    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" containerName="maas-api"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463544    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" containerName="maas-api"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463552    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792d5c35-8e9a-4bc5-afaf-0ebc010299a2" containerName="revoke-keys"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463557    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="792d5c35-8e9a-4bc5-afaf-0ebc010299a2" containerName="revoke-keys"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463569    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463575    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463583    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.463587 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463588    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.463857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463642    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d6a073c-2b24-4a80-80a6-b1a01f7bbbba" containerName="maas-api"
Jul 21 20:09:27.463857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463649    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="792d5c35-8e9a-4bc5-afaf-0ebc010299a2" containerName="revoke-keys"
Jul 21 20:09:27.463857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463656    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.463857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.463662    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf910ee-ef93-44cf-9dab-7518c60bc361" containerName="istio-proxy"
Jul 21 20:09:27.466620 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.466603    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.470361 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.470336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-78cc8875-openshift-default-dockercfg-rqps6\""
Jul 21 20:09:27.485639 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.485602    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:09:27.495258 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.495229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:27.569384 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569570 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569392    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569570 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569570 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58h66\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569570 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569570 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.569820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.569775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.670614 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.670838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.670838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.670838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.670838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.670957    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58h66\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671278 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671432 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671405    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671417    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.671629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.671523    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.673262 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.673238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.673745 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.673706    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.678805 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.678785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.679171 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.679154    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58h66\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66\") pod \"e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") " pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.777953 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.777912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:27.789997 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.789854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:27.916559 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.916531    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:09:27.918940 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:09:27.918912    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaba266c_6f5a_414c_9ef1_2ba54b5dbe19.slice/crio-9e2b7d3a153433eb86910be23f308c1e274d3132dea2112e0ef58224d82776d8 WatchSource:0}: Error finding container 9e2b7d3a153433eb86910be23f308c1e274d3132dea2112e0ef58224d82776d8: Status 404 returned error can't find the container with id 9e2b7d3a153433eb86910be23f308c1e274d3132dea2112e0ef58224d82776d8
Jul 21 20:09:27.921553 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.921513    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:27.921633 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.921602    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:27.921680 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:27.921643    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:28.811030 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:28.810992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerStarted","Data":"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"}
Jul 21 20:09:28.811426 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:28.811051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerStarted","Data":"9e2b7d3a153433eb86910be23f308c1e274d3132dea2112e0ef58224d82776d8"}
Jul 21 20:09:28.832513 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:28.832460    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podStartSLOduration=1.832444585 podStartE2EDuration="1.832444585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:09:28.830844243 +0000 UTC m=+1936.543628818" watchObservedRunningTime="2026-07-21 20:09:28.832444585 +0000 UTC m=+1936.545229158"
Jul 21 20:09:29.778588 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:29.778545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:29.783540 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:29.783509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:29.816229 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:29.816200    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:29.817252 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:29.817232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:30.777035 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.776999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:30.843252 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.843219    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:09:30.846912 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.846890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.849851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.849827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-78cc8875-serving-cert\""
Jul 21 20:09:30.855851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.855827    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:09:30.859496 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.859454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:30.897735 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.897689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.897956 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.897745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.897956 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.897927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7sh\" (UniqueName: \"kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.998675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.998635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.998675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.998678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.998985 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.998759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7sh\" (UniqueName: \"kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:30.998985 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:09:30.998804    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-serving-cert: secret "maas-api-e2e-mt-78cc8875-serving-cert" not found
Jul 21 20:09:30.998985 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:09:30.998878    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls podName:e327d8f6-81e2-4651-9f2b-7c6603c21baf nodeName:}" failed. No retries permitted until 2026-07-21 20:09:31.498849389 +0000 UTC m=+1939.211633939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls") pod "maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" (UID: "e327d8f6-81e2-4651-9f2b-7c6603c21baf") : secret "maas-api-e2e-mt-78cc8875-serving-cert" not found
Jul 21 20:09:30.999347 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:30.999326    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:31.009277 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.009245    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7sh\" (UniqueName: \"kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:31.227216 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.227184    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:31.334403 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.334361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:31.500729 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.500613    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:31.502788 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.502762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:31.505601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.505568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") pod \"maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:31.603301 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.603269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:31.759482 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.759389    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:31.898588 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:31.898563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:09:31.900889 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:09:31.900859    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode327d8f6_81e2_4651_9f2b_7c6603c21baf.slice/crio-604a9809dc28c7540fad38762b00acbc42adced02c47a8055eed70bf8d0a3073 WatchSource:0}: Error finding container 604a9809dc28c7540fad38762b00acbc42adced02c47a8055eed70bf8d0a3073: Status 404 returned error can't find the container with id 604a9809dc28c7540fad38762b00acbc42adced02c47a8055eed70bf8d0a3073
Jul 21 20:09:32.833285 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:32.833247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" event={"ID":"e327d8f6-81e2-4651-9f2b-7c6603c21baf","Type":"ContainerStarted","Data":"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"}
Jul 21 20:09:32.833516 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:32.833309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" event={"ID":"e327d8f6-81e2-4651-9f2b-7c6603c21baf","Type":"ContainerStarted","Data":"604a9809dc28c7540fad38762b00acbc42adced02c47a8055eed70bf8d0a3073"}
Jul 21 20:09:32.833516 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:32.833351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:32.854828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:32.854775    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" podStartSLOduration=2.500070124 podStartE2EDuration="2.854758116s" totalImagesPullingTime="354.687992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:09:32.853124053 +0000 UTC m=+1940.565908626" watchObservedRunningTime="2026-07-21 20:09:32.854758116 +0000 UTC m=+1940.567542689"
Jul 21 20:09:35.302812 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:35.302781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:37.301071 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:37.301019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:38.847854 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:38.847823    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:09:45.488331 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.488290    2573 patch_prober.go:28] interesting pod/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:37638->10.132.0.48:15021: read: connection reset by peer" start-of-body=
Jul 21 20:09:45.488781 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.488369    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:37638->10.132.0.48:15021: read: connection reset by peer"
Jul 21 20:09:45.900044 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.899958    2573 generic.go:356] "Generic (PLEG): container finished" podID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerID="3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427" exitCode=0
Jul 21 20:09:45.900194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.900033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerDied","Data":"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"}
Jul 21 20:09:45.900427 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.900414    2573 scope.go:117] "RemoveContainer" containerID="3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"
Jul 21 20:09:45.901421 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.901390    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:45.901516 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.901488    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:45.901579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:45.901547    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:09:46.907298 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:46.907262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerStarted","Data":"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"}
Jul 21 20:09:47.779110 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:47.779072    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:47.779323 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:47.779298    2573 patch_prober.go:28] interesting pod/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:09:47.779369 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:47.779350    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 20:09:48.231015 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:48.230977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:09:48.778282 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:48.778251    2573 patch_prober.go:28] interesting pod/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:09:48.778455 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:48.778298    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 20:09:49.778827 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:49.778788    2573 patch_prober.go:28] interesting pod/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:09:49.779237 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:49.778847    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 20:09:50.779032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:50.778999    2573 patch_prober.go:28] interesting pod/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:09:50.779414 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:50.779053    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 21 20:09:51.781995 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:51.781963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:51.782415 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:51.782241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:09:51.783032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:09:51.783015    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:10:19.116610 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.116575    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"]
Jul 21 20:10:19.119814 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.119794    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:19.120235 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.120209    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d\" (UID: \"b5a25b50-093e-4c00-9157-ee411125ebbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:19.122221 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.122200    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:10:19.128376 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.128350    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"]
Jul 21 20:10:19.221702 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.221663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d\" (UID: \"b5a25b50-093e-4c00-9157-ee411125ebbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:19.222295 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.222273    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d\" (UID: \"b5a25b50-093e-4c00-9157-ee411125ebbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:19.431659 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.431574    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:19.567183 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:19.567113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"]
Jul 21 20:10:19.569960 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:10:19.569934    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a25b50_093e_4c00_9157_ee411125ebbb.slice/crio-40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05 WatchSource:0}: Error finding container 40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05: Status 404 returned error can't find the container with id 40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05
Jul 21 20:10:20.063838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:20.063747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d" event={"ID":"b5a25b50-093e-4c00-9157-ee411125ebbb","Type":"ContainerStarted","Data":"5703079a3d43063d804a6f9597671d834b42b8a939f0378ed10f8b3dfd0f6e2d"}
Jul 21 20:10:20.063838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:20.063808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d" event={"ID":"b5a25b50-093e-4c00-9157-ee411125ebbb","Type":"ContainerStarted","Data":"40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05"}
Jul 21 20:10:20.081031 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:20.080972    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d" podStartSLOduration=1.080954363 podStartE2EDuration="1.080954363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:10:20.079054556 +0000 UTC m=+1987.791839128" watchObservedRunningTime="2026-07-21 20:10:20.080954363 +0000 UTC m=+1987.793738937"
Jul 21 20:10:21.070128 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:21.070096    2573 generic.go:356] "Generic (PLEG): container finished" podID="b5a25b50-093e-4c00-9157-ee411125ebbb" containerID="5703079a3d43063d804a6f9597671d834b42b8a939f0378ed10f8b3dfd0f6e2d" exitCode=0
Jul 21 20:10:21.070529 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:21.070171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d" event={"ID":"b5a25b50-093e-4c00-9157-ee411125ebbb","Type":"ContainerDied","Data":"5703079a3d43063d804a6f9597671d834b42b8a939f0378ed10f8b3dfd0f6e2d"}
Jul 21 20:10:22.201164 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:22.201140    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:22.243964 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:22.243928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca\") pod \"b5a25b50-093e-4c00-9157-ee411125ebbb\" (UID: \"b5a25b50-093e-4c00-9157-ee411125ebbb\") "
Jul 21 20:10:22.244279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:22.244255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5a25b50-093e-4c00-9157-ee411125ebbb" (UID: "b5a25b50-093e-4c00-9157-ee411125ebbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:10:22.345106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:22.345028    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5a25b50-093e-4c00-9157-ee411125ebbb-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:10:23.081075 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:23.081047    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"
Jul 21 20:10:23.081075 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:23.081070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d" event={"ID":"b5a25b50-093e-4c00-9157-ee411125ebbb","Type":"ContainerDied","Data":"40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05"}
Jul 21 20:10:23.081281 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:23.081113    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e29d916c852d14c8949c588fc056f535440f38b962ffc94f1d7672f7308e05"
Jul 21 20:10:34.501620 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.501582    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:10:34.502114 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.501862    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" podUID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" containerName="maas-api" containerID="cri-o://2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda" gracePeriod=30
Jul 21 20:10:34.526730 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.526689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:10:34.755680 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.755617    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:10:34.836431 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.836399    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm7sh\" (UniqueName: \"kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh\") pod \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") "
Jul 21 20:10:34.836635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.836491    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") pod \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") "
Jul 21 20:10:34.836635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.836534    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca\") pod \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\" (UID: \"e327d8f6-81e2-4651-9f2b-7c6603c21baf\") "
Jul 21 20:10:34.837005 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.836923    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e327d8f6-81e2-4651-9f2b-7c6603c21baf" (UID: "e327d8f6-81e2-4651-9f2b-7c6603c21baf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:10:34.838870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.838830    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e327d8f6-81e2-4651-9f2b-7c6603c21baf" (UID: "e327d8f6-81e2-4651-9f2b-7c6603c21baf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:10:34.838870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.838856    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh" (OuterVolumeSpecName: "kube-api-access-gm7sh") pod "e327d8f6-81e2-4651-9f2b-7c6603c21baf" (UID: "e327d8f6-81e2-4651-9f2b-7c6603c21baf"). InnerVolumeSpecName "kube-api-access-gm7sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:10:34.937708 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.937673    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e327d8f6-81e2-4651-9f2b-7c6603c21baf-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:10:34.937708 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.937702    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e327d8f6-81e2-4651-9f2b-7c6603c21baf-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:10:34.937708 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:34.937735    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm7sh\" (UniqueName: \"kubernetes.io/projected/e327d8f6-81e2-4651-9f2b-7c6603c21baf-kube-api-access-gm7sh\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:10:35.142352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.142255    2573 generic.go:356] "Generic (PLEG): container finished" podID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" containerID="2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda" exitCode=0
Jul 21 20:10:35.142352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.142298    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"
Jul 21 20:10:35.142352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.142321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" event={"ID":"e327d8f6-81e2-4651-9f2b-7c6603c21baf","Type":"ContainerDied","Data":"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"}
Jul 21 20:10:35.142596 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.142370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4" event={"ID":"e327d8f6-81e2-4651-9f2b-7c6603c21baf","Type":"ContainerDied","Data":"604a9809dc28c7540fad38762b00acbc42adced02c47a8055eed70bf8d0a3073"}
Jul 21 20:10:35.142596 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.142397    2573 scope.go:117] "RemoveContainer" containerID="2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"
Jul 21 20:10:35.152256 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.152231    2573 scope.go:117] "RemoveContainer" containerID="2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"
Jul 21 20:10:35.152537 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:10:35.152518    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda\": container with ID starting with 2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda not found: ID does not exist" containerID="2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"
Jul 21 20:10:35.152604 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.152546    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda"} err="failed to get container status \"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda\": rpc error: code = NotFound desc = could not find container \"2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda\": container with ID starting with 2fbd501aa1a02f0ae59a65d8524a0889ceb5ce98c0684a1ec7fe95f651c6adda not found: ID does not exist"
Jul 21 20:10:35.164621 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.164586    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:10:35.168240 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:35.168214    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78cc8875-77867f5fb5-zs4w4"]
Jul 21 20:10:36.414728 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:36.414684    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" path="/var/lib/kubelet/pods/e327d8f6-81e2-4651-9f2b-7c6603c21baf/volumes"
Jul 21 20:10:39.186360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:39.186323    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:10:39.187504 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:39.187476    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"]
Jul 21 20:10:39.189059 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:39.189039    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-78cc8875-xpj6d"]
Jul 21 20:10:40.414612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:40.414579    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5a25b50-093e-4c00-9157-ee411125ebbb" path="/var/lib/kubelet/pods/b5a25b50-093e-4c00-9157-ee411125ebbb/volumes"
Jul 21 20:10:40.611946 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:40.611915    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:10:41.556412 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:41.556371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:10:46.627232 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:10:46.627193    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:14.362655 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:14.362620    2573 scope.go:117] "RemoveContainer" containerID="14bd061fb92d9063a501b620975ca0979927441491fec8e9b1fc0886427499be"
Jul 21 20:11:14.371226 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:14.371205    2573 scope.go:117] "RemoveContainer" containerID="20c294c132ece7f36619e1cd26d3ecb83cb0b9666d394e0addc6becd38b6dc0a"
Jul 21 20:11:21.491944 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:21.491903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:21.592173 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:21.592126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:23.070554 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:23.070520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:23.170799 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:23.170763    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:23.503300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:23.503264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:29.039238 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:29.039201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:43.197389 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.197351    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:43.262939 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.262895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:43.468395 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.468369    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:11:43.468573 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.468552    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy" containerID="cri-o://c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012" gracePeriod=30
Jul 21 20:11:43.493533 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.493505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:43.781878 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:43.781787    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:44.959374 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:44.959339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:45.055854 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:45.055821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:45.158379 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:45.158349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:45.966243 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:45.966191    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:46.065087 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:46.065044    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:46.171370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:46.171333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:47.623192 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:47.623161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:48.716565 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.716536    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:11:48.775084 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.774991    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775084 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775090    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58h66\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775171    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775208    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775245    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775621 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs\") pod \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\" (UID: \"faba266c-6f5a-414c-9ef1-2ba54b5dbe19\") "
Jul 21 20:11:48.775621 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775434    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:11:48.775621 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775527    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:11:48.775826 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775706    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:11:48.775826 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775783    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.775826 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775801    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.775968 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775863    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data" (OuterVolumeSpecName: "istio-data") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:11:48.775968 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.775879    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:11:48.777413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.777390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:11:48.777491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.777458    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66" (OuterVolumeSpecName: "kube-api-access-58h66") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "kube-api-access-58h66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:11:48.777876 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.777858    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:11:48.777962 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.777947    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token" (OuterVolumeSpecName: "istio-token") pod "faba266c-6f5a-414c-9ef1-2ba54b5dbe19" (UID: "faba266c-6f5a-414c-9ef1-2ba54b5dbe19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:11:48.876635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876597    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58h66\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-kube-api-access-58h66\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876628    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876638    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876649    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876657    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876664    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:48.876900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:48.876672    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faba266c-6f5a-414c-9ef1-2ba54b5dbe19-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:11:49.498224 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.498190    2573 generic.go:356] "Generic (PLEG): container finished" podID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerID="c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012" exitCode=0
Jul 21 20:11:49.498411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.498239    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"
Jul 21 20:11:49.498411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.498292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerDied","Data":"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"}
Jul 21 20:11:49.498411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.498347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74" event={"ID":"faba266c-6f5a-414c-9ef1-2ba54b5dbe19","Type":"ContainerDied","Data":"9e2b7d3a153433eb86910be23f308c1e274d3132dea2112e0ef58224d82776d8"}
Jul 21 20:11:49.498411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.498369    2573 scope.go:117] "RemoveContainer" containerID="c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"
Jul 21 20:11:49.507639 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.507614    2573 scope.go:117] "RemoveContainer" containerID="3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"
Jul 21 20:11:49.515328 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.515306    2573 scope.go:117] "RemoveContainer" containerID="c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"
Jul 21 20:11:49.515610 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:11:49.515591    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012\": container with ID starting with c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012 not found: ID does not exist" containerID="c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"
Jul 21 20:11:49.515649 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.515619    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012"} err="failed to get container status \"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012\": rpc error: code = NotFound desc = could not find container \"c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012\": container with ID starting with c2f75500f92abc57bede86841b177c4ea34700df828b19aa22ba48e05c891012 not found: ID does not exist"
Jul 21 20:11:49.515649 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.515637    2573 scope.go:117] "RemoveContainer" containerID="3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"
Jul 21 20:11:49.515905 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:11:49.515887    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427\": container with ID starting with 3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427 not found: ID does not exist" containerID="3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"
Jul 21 20:11:49.515946 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.515911    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427"} err="failed to get container status \"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427\": rpc error: code = NotFound desc = could not find container \"3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427\": container with ID starting with 3cfc87c88d0fd51929f4ff4c40c50198f4c34732bced49ec1d01df2d688cc427 not found: ID does not exist"
Jul 21 20:11:49.523011 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.522987    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:11:49.526931 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:49.526908    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-78cc8875-openshift-default-685b475f8c-fnp74"]
Jul 21 20:11:50.415219 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:50.415183    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" path="/var/lib/kubelet/pods/faba266c-6f5a-414c-9ef1-2ba54b5dbe19/volumes"
Jul 21 20:11:53.384134 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:53.384105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:53.448536 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:53.448501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:54.107774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:54.107735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:11:59.947369 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:11:59.947332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:00.048854 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:00.048823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:00.147575 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:00.147531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:10.678857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:10.678816    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:11.030245 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:11.030203    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:14.397320 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:14.397282    2573 scope.go:117] "RemoveContainer" containerID="713dea1b2b5d2b1bbe1783d96c71214826e7592a98d59f135dfd6a2e6cb874c3"
Jul 21 20:12:32.023256 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:32.023212    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:38.557163 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:38.557124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:38.623030 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:38.622996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:38.938809 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:38.938706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:39.359055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359015    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:12:39.359471 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359457    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.359524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359474    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.359524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359489    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.359524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359498    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.359524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359512    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" containerName="maas-api"
Jul 21 20:12:39.359524 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359520    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" containerName="maas-api"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359541    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a25b50-093e-4c00-9157-ee411125ebbb" containerName="revoke-keys"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359551    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a25b50-093e-4c00-9157-ee411125ebbb" containerName="revoke-keys"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359622    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e327d8f6-81e2-4651-9f2b-7c6603c21baf" containerName="maas-api"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359633    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359642    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a25b50-093e-4c00-9157-ee411125ebbb" containerName="revoke-keys"
Jul 21 20:12:39.359700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.359651    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="faba266c-6f5a-414c-9ef1-2ba54b5dbe19" containerName="istio-proxy"
Jul 21 20:12:39.362827 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.362805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.366183 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.366163    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c3ae20-openshift-default-dockercfg-vv2g4\""
Jul 21 20:12:39.382315 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.382293    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:12:39.405080 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.405049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:39.535495 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnj6m\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535887 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535887 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.535887 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.535845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.636843 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.636843 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.636843 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnj6m\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.636975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637282    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637853 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637553    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.637899 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.637878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.639410 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.639389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.639578 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.639561    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.647120 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.647090    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.647448 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.647416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnj6m\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m\") pod \"e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") " pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.673021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.672987    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:39.819564 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.819526    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:12:39.824162 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:12:39.824128    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b6e1f0_4caa_4820_a886_ec3ac4b0083a.slice/crio-e1c67ec6d5aa00ea5e3d46929a246210ec47c622166700568b1de0f95db8c091 WatchSource:0}: Error finding container e1c67ec6d5aa00ea5e3d46929a246210ec47c622166700568b1de0f95db8c091: Status 404 returned error can't find the container with id e1c67ec6d5aa00ea5e3d46929a246210ec47c622166700568b1de0f95db8c091
Jul 21 20:12:39.826106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.826073    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:39.826203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.826141    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:39.826203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.826177    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:39.886336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:39.886304    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:40.740351 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:40.740315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerStarted","Data":"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"}
Jul 21 20:12:40.740768 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:40.740374    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerStarted","Data":"e1c67ec6d5aa00ea5e3d46929a246210ec47c622166700568b1de0f95db8c091"}
Jul 21 20:12:40.764734 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:40.764677    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podStartSLOduration=1.7646605960000001 podStartE2EDuration="1.764660596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:12:40.762918692 +0000 UTC m=+2128.475703288" watchObservedRunningTime="2026-07-21 20:12:40.764660596 +0000 UTC m=+2128.477445169"
Jul 21 20:12:41.673923 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:41.673882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:41.678694 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:41.678665    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:41.745430 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:41.745395    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:41.746375 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:41.746353    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:42.720044 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.720013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:42.818609 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.818560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:42.917986 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.917951    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:12:42.921650 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.921631    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:42.924952 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.924925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c3ae20-serving-cert\""
Jul 21 20:12:42.933007 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.932980    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:12:42.971962 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:42.971869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:43.068410 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.068365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.068410 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.068403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95c2j\" (UniqueName: \"kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.068640 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.068432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.169416 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.169378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.169416 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.169420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95c2j\" (UniqueName: \"kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.169646 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.169452    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.169646 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:12:43.169569    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-serving-cert: secret "maas-api-e2e-inf-a-c3ae20-serving-cert" not found
Jul 21 20:12:43.169646 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:12:43.169634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls podName:22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb nodeName:}" failed. No retries permitted until 2026-07-21 20:12:43.669614789 +0000 UTC m=+2131.382399353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls") pod "maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" (UID: "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb") : secret "maas-api-e2e-inf-a-c3ae20-serving-cert" not found
Jul 21 20:12:43.170312 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.170286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.180490 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.180462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95c2j\" (UniqueName: \"kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.334348 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.334249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:43.517473 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.517436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:43.618366 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.618281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:43.674364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.674334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.676820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.676790    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") pod \"maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:43.834106 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:43.834069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:44.000223 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.000151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:12:44.002446 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:12:44.002413    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d1bf30_b5e3_4095_ac2b_2ac0f3bb5efb.slice/crio-fff0f2814a137794b420c3fa2b8b89a8f3a3c8e3f135e66e99a2e330184bdf5a WatchSource:0}: Error finding container fff0f2814a137794b420c3fa2b8b89a8f3a3c8e3f135e66e99a2e330184bdf5a: Status 404 returned error can't find the container with id fff0f2814a137794b420c3fa2b8b89a8f3a3c8e3f135e66e99a2e330184bdf5a
Jul 21 20:12:44.003908 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.003886    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:12:44.764671 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.764585    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" event={"ID":"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb","Type":"ContainerStarted","Data":"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"}
Jul 21 20:12:44.764671 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.764638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" event={"ID":"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb","Type":"ContainerStarted","Data":"fff0f2814a137794b420c3fa2b8b89a8f3a3c8e3f135e66e99a2e330184bdf5a"}
Jul 21 20:12:44.764896 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.764737    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:44.789410 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:44.789351    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" podStartSLOduration=2.325455443 podStartE2EDuration="2.78933536s" totalImagesPullingTime="463.879917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:12:44.788523869 +0000 UTC m=+2132.501308442" watchObservedRunningTime="2026-07-21 20:12:44.78933536 +0000 UTC m=+2132.502119932"
Jul 21 20:12:47.246568 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:47.246531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:47.584404 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:47.584313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:47.983202 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:47.983169    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:12:47.986154 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:47.986135    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:47.988776 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:47.988750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-839c41-openshift-default-dockercfg-ggf5z\""
Jul 21 20:12:48.001060 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.001027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:12:48.011552 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.011523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:48.113529 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.113495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:48.120550 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsb9g\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120925 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120925 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.120925 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.120907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222061 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222061 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222277    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsb9g\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222653 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222622    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222709 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222791 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.222985 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.223067 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.222979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.224469 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.224448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.224819 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.224799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.231549 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.231522    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.231675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.231657    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsb9g\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g\") pod \"e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") " pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.296531 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.296430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:48.443492 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.443465    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:12:48.445839 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:12:48.445808    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733a97b4_400a_4613_bdb4_62e1fc3b69fe.slice/crio-c378f0254f086be74d4adc0cf8570386682ac73d4e8e66597c2cf624ea530eee WatchSource:0}: Error finding container c378f0254f086be74d4adc0cf8570386682ac73d4e8e66597c2cf624ea530eee: Status 404 returned error can't find the container with id c378f0254f086be74d4adc0cf8570386682ac73d4e8e66597c2cf624ea530eee
Jul 21 20:12:48.448028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.447991    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:48.448118 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.448097    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:48.448156 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.448130    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:48.784422 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.784386    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerStarted","Data":"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"}
Jul 21 20:12:48.784604 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.784448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerStarted","Data":"c378f0254f086be74d4adc0cf8570386682ac73d4e8e66597c2cf624ea530eee"}
Jul 21 20:12:48.815749 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:48.812396    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podStartSLOduration=1.812375094 podStartE2EDuration="1.812375094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:12:48.809200084 +0000 UTC m=+2136.521984656" watchObservedRunningTime="2026-07-21 20:12:48.812375094 +0000 UTC m=+2136.525159671"
Jul 21 20:12:49.296974 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:49.296931    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:49.302314 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:49.302289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:49.789608 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:49.789579    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:49.790630 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:49.790609    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:12:50.774346 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:50.774317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:12:50.789751 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:50.789702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:50.881309 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:50.881264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:51.062180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.062086    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:12:51.070013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.069986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.073616 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.073591    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-839c41-serving-cert\""
Jul 21 20:12:51.078299 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.078216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:12:51.100773 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.100743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:51.148156 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.148120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr25p\" (UniqueName: \"kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.148452 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.148428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.148572 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.148557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.200440 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.200404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:51.249324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.249283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.249525 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.249334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.249525 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.249487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr25p\" (UniqueName: \"kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.251079 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.251049    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.253837 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.253810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.260263 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.260234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr25p\" (UniqueName: \"kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p\") pod \"maas-api-e2e-inf-b-839c41-58cd7579d9-8svps\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.387774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.387683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:51.564210 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.564169    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:12:51.569107 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:12:51.569070    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8362f273_b6e1_4eca_a2f1_239cdcd8eeb4.slice/crio-4f29bcee669509a086b62f51976a842dbb2c5a3d44a5ebf423f6439f50234632 WatchSource:0}: Error finding container 4f29bcee669509a086b62f51976a842dbb2c5a3d44a5ebf423f6439f50234632: Status 404 returned error can't find the container with id 4f29bcee669509a086b62f51976a842dbb2c5a3d44a5ebf423f6439f50234632
Jul 21 20:12:51.783891 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.783837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:51.799651 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.799616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" event={"ID":"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4","Type":"ContainerStarted","Data":"4f29bcee669509a086b62f51976a842dbb2c5a3d44a5ebf423f6439f50234632"}
Jul 21 20:12:51.912192 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:51.912159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:52.806037 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:52.806003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" event={"ID":"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4","Type":"ContainerStarted","Data":"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"}
Jul 21 20:12:52.806541 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:52.806069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:52.829356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:52.829305    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" podStartSLOduration=1.029537146 podStartE2EDuration="1.829283964s" totalImagesPullingTime="799.746818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:12:52.829252497 +0000 UTC m=+2140.542037088" watchObservedRunningTime="2026-07-21 20:12:52.829283964 +0000 UTC m=+2140.542068539"
Jul 21 20:12:55.306688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.306651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:12:55.821905 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.821879    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerID="22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc" exitCode=0
Jul 21 20:12:55.822064 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.821948    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerDied","Data":"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"}
Jul 21 20:12:55.822351 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.822333    2573 scope.go:117] "RemoveContainer" containerID="22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"
Jul 21 20:12:55.823399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.823373    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:55.823469 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.823439    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:55.823508 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:55.823471    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:12:56.745475 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:56.745427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:56.828134 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:56.828101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerStarted","Data":"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"}
Jul 21 20:12:57.673267 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:57.673227    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:12:57.674275 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:57.674257    2573 patch_prober.go:28] interesting pod/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:12:57.674360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:57.674325    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 20:12:58.674523 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:58.674484    2573 patch_prober.go:28] interesting pod/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:12:58.675240 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:58.675129    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 20:12:58.817579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:58.817546    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:12:59.673443 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:59.673400    2573 patch_prober.go:28] interesting pod/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:12:59.673772 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:12:59.673737    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 20:13:00.673751 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:00.673700    2573 patch_prober.go:28] interesting pod/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:13:00.674142 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:00.673784    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 21 20:13:01.677603 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:01.677573    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:13:01.678046 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:01.677961    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:13:01.678594 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:01.678572    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:13:03.731413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:03.731380    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:13:04.400273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.400188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:13:04.499275 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.499236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:13:04.791683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.791649    2573 patch_prober.go:28] interesting pod/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 20:13:04.792115 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.791744    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 20:13:04.880272 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.880234    2573 generic.go:356] "Generic (PLEG): container finished" podID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerID="9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a" exitCode=0
Jul 21 20:13:04.880625 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.880310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerDied","Data":"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"}
Jul 21 20:13:04.880791 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.880774    2573 scope.go:117] "RemoveContainer" containerID="9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"
Jul 21 20:13:04.881858 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.881826    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:13:04.882031 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.881907    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:13:04.882031 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:04.881959    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:13:05.886819 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:05.886785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerStarted","Data":"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"}
Jul 21 20:13:06.297485 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:06.297446    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:13:06.297675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:06.297641    2573 patch_prober.go:28] interesting pod/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 20:13:06.297767 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:06.297692    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 20:13:07.297167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:07.297126    2573 patch_prober.go:28] interesting pod/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 20:13:07.297556 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:07.297184    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 20:13:08.297501 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:08.297464    2573 patch_prober.go:28] interesting pod/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 20:13:08.297920 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:08.297521    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 20:13:09.297081 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:09.297042    2573 patch_prober.go:28] interesting pod/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 21 20:13:09.297269 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:09.297111    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 21 20:13:10.302171 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:10.302140    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:13:10.302573 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:10.302516    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:13:10.303135 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:10.303118    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:13:13.650014 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:13.649979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:13:13.877528 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:13.877490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:13:14.420331 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:14.420295    2573 scope.go:117] "RemoveContainer" containerID="a86c0907c99b85fd4002dadcb4c40bcdb7d3934867f6d76e85d85c12ab388b7e"
Jul 21 20:13:44.480254 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:13:44.480210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:25.458221 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:25.458178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:26.465536 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:26.465497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:27.165861 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:27.165828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:27.262842 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:27.262806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:37.002153 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.002082    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:14:37.002576 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.002278    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" podUID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" containerName="maas-api" containerID="cri-o://e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e" gracePeriod=30
Jul 21 20:14:37.035888 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.035860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:37.253532 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.253465    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:14:37.321945 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.321914    2573 generic.go:356] "Generic (PLEG): container finished" podID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" containerID="e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e" exitCode=0
Jul 21 20:14:37.322097 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.321960    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"
Jul 21 20:14:37.322097 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.321997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" event={"ID":"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb","Type":"ContainerDied","Data":"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"}
Jul 21 20:14:37.322097 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.322074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4" event={"ID":"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb","Type":"ContainerDied","Data":"fff0f2814a137794b420c3fa2b8b89a8f3a3c8e3f135e66e99a2e330184bdf5a"}
Jul 21 20:14:37.322209 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.322098    2573 scope.go:117] "RemoveContainer" containerID="e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"
Jul 21 20:14:37.330300 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.330273    2573 scope.go:117] "RemoveContainer" containerID="e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"
Jul 21 20:14:37.330565 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:14:37.330535    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e\": container with ID starting with e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e not found: ID does not exist" containerID="e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"
Jul 21 20:14:37.330666 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.330571    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e"} err="failed to get container status \"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e\": rpc error: code = NotFound desc = could not find container \"e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e\": container with ID starting with e6b295f85b7001ad7eacb9651ccc49726e9aa94022bcc12d881d115a3e8c1e3e not found: ID does not exist"
Jul 21 20:14:37.374671 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.374642    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca\") pod \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") "
Jul 21 20:14:37.374833 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.374692    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") pod \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") "
Jul 21 20:14:37.374833 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.374733    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95c2j\" (UniqueName: \"kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j\") pod \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\" (UID: \"22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb\") "
Jul 21 20:14:37.375004 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.374983    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" (UID: "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:14:37.376866 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.376842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" (UID: "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:14:37.376995 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.376948    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j" (OuterVolumeSpecName: "kube-api-access-95c2j") pod "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" (UID: "22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb"). InnerVolumeSpecName "kube-api-access-95c2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:14:37.476099 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.476065    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:37.476099 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.476092    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:37.476099 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.476105    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95c2j\" (UniqueName: \"kubernetes.io/projected/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb-kube-api-access-95c2j\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:37.649650 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.649617    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:14:37.656142 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:37.656117    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c3ae20-54b74b8d74-jzfl4"]
Jul 21 20:14:38.415215 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:38.415182    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" path="/var/lib/kubelet/pods/22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb/volumes"
Jul 21 20:14:41.747348 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:41.747309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:43.171089 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:43.171056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.276314 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.276278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.373181 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.373147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.594170 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.594075    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:14:49.594330 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.594291    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy" containerID="cri-o://7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac" gracePeriod=30
Jul 21 20:14:49.629606 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.629563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.903635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:49.903539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:50.945847 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:50.945807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:51.058589 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:51.058557    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:54.843675 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.843648    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:14:54.925009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.924928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925009 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.924968    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925023    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925140    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnj6m\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925165    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925196    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:14:54.925500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy\") pod \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\" (UID: \"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a\") "
Jul 21 20:14:54.925500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925307    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:14:54.925500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925476    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:14:54.925711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925519    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:54.925711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925536    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:54.925711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925609    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:14:54.925920 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.925842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:14:54.927488 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.927456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:14:54.927488 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.927465    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:14:54.927654 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.927510    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:14:54.927654 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:54.927536    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m" (OuterVolumeSpecName: "kube-api-access-xnj6m") pod "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" (UID: "c1b6e1f0-4caa-4820-a886-ec3ac4b0083a"). InnerVolumeSpecName "kube-api-access-xnj6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:14:55.026774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026738    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.026774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026766    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.026774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026774    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.026774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026782    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.027051 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026791    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnj6m\" (UniqueName: \"kubernetes.io/projected/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-kube-api-access-xnj6m\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.027051 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026801    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.027051 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.026809    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:14:55.407405 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.407369    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerID="7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac" exitCode=0
Jul 21 20:14:55.407601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.407433    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"
Jul 21 20:14:55.407601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.407458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerDied","Data":"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"}
Jul 21 20:14:55.407601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.407553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5" event={"ID":"c1b6e1f0-4caa-4820-a886-ec3ac4b0083a","Type":"ContainerDied","Data":"e1c67ec6d5aa00ea5e3d46929a246210ec47c622166700568b1de0f95db8c091"}
Jul 21 20:14:55.407601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.407586    2573 scope.go:117] "RemoveContainer" containerID="7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"
Jul 21 20:14:55.416711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.416694    2573 scope.go:117] "RemoveContainer" containerID="22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"
Jul 21 20:14:55.424711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.424691    2573 scope.go:117] "RemoveContainer" containerID="7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"
Jul 21 20:14:55.424973 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:14:55.424954    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac\": container with ID starting with 7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac not found: ID does not exist" containerID="7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"
Jul 21 20:14:55.425054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.424985    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac"} err="failed to get container status \"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac\": rpc error: code = NotFound desc = could not find container \"7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac\": container with ID starting with 7d1738539ee166a9719d6f4aa30f940eb1ffd0304ff9ed72d40ab16a34ca03ac not found: ID does not exist"
Jul 21 20:14:55.425054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.425009    2573 scope.go:117] "RemoveContainer" containerID="22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"
Jul 21 20:14:55.425224 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:14:55.425205    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc\": container with ID starting with 22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc not found: ID does not exist" containerID="22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"
Jul 21 20:14:55.425264 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.425229    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc"} err="failed to get container status \"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc\": rpc error: code = NotFound desc = could not find container \"22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc\": container with ID starting with 22abdff640a24c8de414d4b3798abc2b054fd9868c0e9a15254e28209569bbcc not found: ID does not exist"
Jul 21 20:14:55.435869 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.435847    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:14:55.449222 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:55.449199    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c3ae20-openshift-default-5b9bb495d9-5q4k5"]
Jul 21 20:14:56.415458 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:14:56.415420    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" path="/var/lib/kubelet/pods/c1b6e1f0-4caa-4820-a886-ec3ac4b0083a/volumes"
Jul 21 20:15:00.149796 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.149755    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150100    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150113    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150128    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" containerName="maas-api"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150133    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" containerName="maas-api"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150193    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="22d1bf30-b5e3-4095-ac2b-2ac0f3bb5efb" containerName="maas-api"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150202    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.150260 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.150209    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.154658 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.154639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"
Jul 21 20:15:00.157519 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.157487    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:15:00.159177 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.159156    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"]
Jul 21 20:15:00.159447 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.159435    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.159495 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.159448    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b6e1f0-4caa-4820-a886-ec3ac4b0083a" containerName="istio-proxy"
Jul 21 20:15:00.162318 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.162296    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"
Jul 21 20:15:00.164901 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.164883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"
Jul 21 20:15:00.167381 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.167360    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:00.175623 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.175597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"]
Jul 21 20:15:00.177619 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.177594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"
Jul 21 20:15:00.325827 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.325634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:00.329330 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:00.329301    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9eb499_ff1c_4ed6_b61d_3b5821dbfb5e.slice/crio-efa8d66edcdfcf4fcc5707b64d17f220a0d6c24833297f8084f08c1426cbb38e WatchSource:0}: Error finding container efa8d66edcdfcf4fcc5707b64d17f220a0d6c24833297f8084f08c1426cbb38e: Status 404 returned error can't find the container with id efa8d66edcdfcf4fcc5707b64d17f220a0d6c24833297f8084f08c1426cbb38e
Jul 21 20:15:00.349005 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.348982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"]
Jul 21 20:15:00.351319 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:00.351293    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b0f725_7616_4ee5_89b3_b48b0fbdfe2e.slice/crio-a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6 WatchSource:0}: Error finding container a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6: Status 404 returned error can't find the container with id a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6
Jul 21 20:15:00.433075 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.432982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v" event={"ID":"38b0f725-7616-4ee5-89b3-b48b0fbdfe2e","Type":"ContainerStarted","Data":"a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6"}
Jul 21 20:15:00.434100 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.434077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp" event={"ID":"fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e","Type":"ContainerStarted","Data":"efa8d66edcdfcf4fcc5707b64d17f220a0d6c24833297f8084f08c1426cbb38e"}
Jul 21 20:15:00.528412 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.528370    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:15:00.528645 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.528617    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" podUID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" containerName="maas-api" containerID="cri-o://89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8" gracePeriod=30
Jul 21 20:15:00.580124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.580092    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:00.581052 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.581005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:00.764526 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.764505    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:15:00.887872 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.887834    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr25p\" (UniqueName: \"kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p\") pod \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") "
Jul 21 20:15:00.888042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.887887    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca\") pod \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") "
Jul 21 20:15:00.888042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.887974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls\") pod \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\" (UID: \"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4\") "
Jul 21 20:15:00.888283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.888254    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" (UID: "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:15:00.889996 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.889961    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p" (OuterVolumeSpecName: "kube-api-access-mr25p") pod "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" (UID: "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4"). InnerVolumeSpecName "kube-api-access-mr25p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:15:00.890088 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.890033    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" (UID: "8362f273-b6e1-4eca-a2f1-239cdcd8eeb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:15:00.988657 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.988624    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:00.988657 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.988653    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr25p\" (UniqueName: \"kubernetes.io/projected/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-kube-api-access-mr25p\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:00.988657 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:00.988663    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:01.443154 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.443057    2573 generic.go:356] "Generic (PLEG): container finished" podID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" containerID="89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8" exitCode=0
Jul 21 20:15:01.443154 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.443113    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"
Jul 21 20:15:01.443154 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.443142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" event={"ID":"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4","Type":"ContainerDied","Data":"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"}
Jul 21 20:15:01.443703 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.443203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps" event={"ID":"8362f273-b6e1-4eca-a2f1-239cdcd8eeb4","Type":"ContainerDied","Data":"4f29bcee669509a086b62f51976a842dbb2c5a3d44a5ebf423f6439f50234632"}
Jul 21 20:15:01.443703 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.443232    2573 scope.go:117] "RemoveContainer" containerID="89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"
Jul 21 20:15:01.445140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.444990    2573 generic.go:356] "Generic (PLEG): container finished" podID="fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e" containerID="df08d9d18a52e2e8b9b717588deb88f36f694c657b040a06032b15990bf578a4" exitCode=6
Jul 21 20:15:01.445140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.445075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp" event={"ID":"fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e","Type":"ContainerDied","Data":"df08d9d18a52e2e8b9b717588deb88f36f694c657b040a06032b15990bf578a4"}
Jul 21 20:15:01.446983 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.446959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v" event={"ID":"38b0f725-7616-4ee5-89b3-b48b0fbdfe2e","Type":"ContainerStarted","Data":"c7172a8bb2953ca80af6929bfaaed160ad00471d197ffd2abee3e96a229d547a"}
Jul 21 20:15:01.454359 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.454340    2573 scope.go:117] "RemoveContainer" containerID="89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"
Jul 21 20:15:01.454644 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:01.454625    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8\": container with ID starting with 89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8 not found: ID does not exist" containerID="89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"
Jul 21 20:15:01.454706 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.454652    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8"} err="failed to get container status \"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8\": rpc error: code = NotFound desc = could not find container \"89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8\": container with ID starting with 89cc65ca4133309fe750412686b598b9bf76448ce0b4bb00a3101a9aed72b8e8 not found: ID does not exist"
Jul 21 20:15:01.510345 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.510297    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v" podStartSLOduration=1.510278735 podStartE2EDuration="1.510278735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:01.507916108 +0000 UTC m=+2269.220700683" watchObservedRunningTime="2026-07-21 20:15:01.510278735 +0000 UTC m=+2269.223063308"
Jul 21 20:15:01.532197 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.532170    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:15:01.533949 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.533923    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-839c41-58cd7579d9-8svps"]
Jul 21 20:15:01.574629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:01.574608    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"
Jul 21 20:15:02.421043 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.421007    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" path="/var/lib/kubelet/pods/8362f273-b6e1-4eca-a2f1-239cdcd8eeb4/volumes"
Jul 21 20:15:02.453564 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.453537    2573 generic.go:356] "Generic (PLEG): container finished" podID="38b0f725-7616-4ee5-89b3-b48b0fbdfe2e" containerID="c7172a8bb2953ca80af6929bfaaed160ad00471d197ffd2abee3e96a229d547a" exitCode=0
Jul 21 20:15:02.453957 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.453616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v" event={"ID":"38b0f725-7616-4ee5-89b3-b48b0fbdfe2e","Type":"ContainerDied","Data":"c7172a8bb2953ca80af6929bfaaed160ad00471d197ffd2abee3e96a229d547a"}
Jul 21 20:15:02.455820 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.455794    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"
Jul 21 20:15:02.455939 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.455791    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp" event={"ID":"fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e","Type":"ContainerDied","Data":"efa8d66edcdfcf4fcc5707b64d17f220a0d6c24833297f8084f08c1426cbb38e"}
Jul 21 20:15:02.455988 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.455936    2573 scope.go:117] "RemoveContainer" containerID="df08d9d18a52e2e8b9b717588deb88f36f694c657b040a06032b15990bf578a4"
Jul 21 20:15:02.498397 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.498371    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:02.503703 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:02.503678    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-839c41-29744415-sjgcp"]
Jul 21 20:15:03.592211 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:03.592188    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"
Jul 21 20:15:04.415003 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:04.414967    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e" path="/var/lib/kubelet/pods/fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e/volumes"
Jul 21 20:15:04.469843 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:04.469812    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v"
Jul 21 20:15:04.470011 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:04.469854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744415-ws94v" event={"ID":"38b0f725-7616-4ee5-89b3-b48b0fbdfe2e","Type":"ContainerDied","Data":"a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6"}
Jul 21 20:15:04.470011 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:04.469900    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a70fcbcee090d3ad90216fe3c8eb73240469d47800bd5053129b8aef50fd6bd6"
Jul 21 20:15:05.134879 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:05.134843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:05.542522 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:05.542482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:05.865605 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:05.865517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:05.969923 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:05.969882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:11.910515 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:11.910476    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:12.062047 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.062013    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:12.127900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.127869    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:15:12.128144 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.128123    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy" containerID="cri-o://cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846" gracePeriod=30
Jul 21 20:15:12.408097 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.408064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:12.510758 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.510689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:12.744141 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:12.744109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:13.087963 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.087874    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088337    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" containerName="maas-api"
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088358    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" containerName="maas-api"
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088374    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b0f725-7616-4ee5-89b3-b48b0fbdfe2e" containerName="cleanup"
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088382    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b0f725-7616-4ee5-89b3-b48b0fbdfe2e" containerName="cleanup"
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088396    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e" containerName="cleanup"
Jul 21 20:15:13.088459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088404    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e" containerName="cleanup"
Jul 21 20:15:13.088774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088498    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9eb499-ff1c-4ed6-b61d-3b5821dbfb5e" containerName="cleanup"
Jul 21 20:15:13.088774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088511    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b0f725-7616-4ee5-89b3-b48b0fbdfe2e" containerName="cleanup"
Jul 21 20:15:13.088774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.088523    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8362f273-b6e1-4eca-a2f1-239cdcd8eeb4" containerName="maas-api"
Jul 21 20:15:13.091857 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.091837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.094954 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.094934    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-661123-openshift-default-dockercfg-jhm29\""
Jul 21 20:15:13.107841 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.107818    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:15:13.124334 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.124307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:13.190962 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.190906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.190980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191360 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191447 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.191447 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.191408    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmj6\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292063 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292063 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292327 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmj6\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.292967 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.292945    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.293057 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.293040    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.294478 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.294451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.294674 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.294654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.303280 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.303253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmj6\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.303390 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.303287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token\") pod \"e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") " pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.360477 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.360385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:13.402517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.402486    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:13.550956 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.548915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:15:13.551603 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:13.551572    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb91a994_0973_4d2e_b2be_4ccecc6ad4ae.slice/crio-0410fadebff3c1891b634a25141a0b7f5699560776e33da01319591196cb8f75 WatchSource:0}: Error finding container 0410fadebff3c1891b634a25141a0b7f5699560776e33da01319591196cb8f75: Status 404 returned error can't find the container with id 0410fadebff3c1891b634a25141a0b7f5699560776e33da01319591196cb8f75
Jul 21 20:15:13.554219 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.554185    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:13.554336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.554265    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:13.554336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:13.554310    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:14.445055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:14.445026    2573 scope.go:117] "RemoveContainer" containerID="1e64356ac104daa3fd96f08ae941e91859aee6b63ef63b4953ae52dd3e513707"
Jul 21 20:15:14.516932 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:14.516899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerStarted","Data":"a5f25c78d9ea8d54657f486fdf90877c405cf21b92c49e08f4ef95d61ae9c0ca"}
Jul 21 20:15:14.517058 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:14.516949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerStarted","Data":"0410fadebff3c1891b634a25141a0b7f5699560776e33da01319591196cb8f75"}
Jul 21 20:15:14.544601 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:14.544551    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podStartSLOduration=1.544536383 podStartE2EDuration="1.544536383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:14.543030698 +0000 UTC m=+2282.255815270" watchObservedRunningTime="2026-07-21 20:15:14.544536383 +0000 UTC m=+2282.257320956"
Jul 21 20:15:15.402770 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:15.402706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:15.407532 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:15.407499    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:15.521967 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:15.521937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:15.522964 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:15.522945    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:16.675352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.675319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:16.738990 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.738957    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:16.743753 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.743730    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.746544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.746520    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-661123-serving-cert\""
Jul 21 20:15:16.761162 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.761131    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:16.781850 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.781821    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:16.824488 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.824423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.828766 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.825019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.828766 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.825123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwm7w\" (UniqueName: \"kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.878038 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.878005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:16.925880 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.925779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.926028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.925941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.926028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.925971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwm7w\" (UniqueName: \"kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.926123 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:16.926104    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-661123-serving-cert: secret "maas-api-e2e-api-a-661123-serving-cert" not found
Jul 21 20:15:16.926203 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:16.926192    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls podName:0bd81021-714a-4a2c-9a1c-6c0d790fe38f nodeName:}" failed. No retries permitted until 2026-07-21 20:15:17.426170887 +0000 UTC m=+2285.138955449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls") pod "maas-api-e2e-api-a-661123-5744d577bd-5x8zw" (UID: "0bd81021-714a-4a2c-9a1c-6c0d790fe38f") : secret "maas-api-e2e-api-a-661123-serving-cert" not found
Jul 21 20:15:16.926465 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.926441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:16.938365 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:16.938331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwm7w\" (UniqueName: \"kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:17.238417 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.238385    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:17.389195 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.389167    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:15:17.430974 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.430925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:17.433433 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.433408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") pod \"maas-api-e2e-api-a-661123-5744d577bd-5x8zw\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:17.490699 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.490591    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:17.531364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531375    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531462    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531492    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531537 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531516    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531552    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531596    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsb9g\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.531811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531660    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy\") pod \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\" (UID: \"733a97b4-400a-4613-bdb4-62e1fc3b69fe\") "
Jul 21 20:15:17.532021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531831    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:15:17.532021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531850    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:15:17.532021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.531874    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:15:17.532021 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532006    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.532232 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532026    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.532232 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532040    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.532232 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532095    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:15:17.532877 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532848    2573 generic.go:356] "Generic (PLEG): container finished" podID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerID="cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846" exitCode=0
Jul 21 20:15:17.533018 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532895    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"
Jul 21 20:15:17.533018 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerDied","Data":"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"}
Jul 21 20:15:17.533018 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.532989    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r" event={"ID":"733a97b4-400a-4613-bdb4-62e1fc3b69fe","Type":"ContainerDied","Data":"c378f0254f086be74d4adc0cf8570386682ac73d4e8e66597c2cf624ea530eee"}
Jul 21 20:15:17.533018 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.533018    2573 scope.go:117] "RemoveContainer" containerID="cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"
Jul 21 20:15:17.533220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.533016    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:15:17.534592 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.534564    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:15:17.534787 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.534764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:15:17.534868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.534798    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g" (OuterVolumeSpecName: "kube-api-access-rsb9g") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "kube-api-access-rsb9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:15:17.534868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.534848    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "733a97b4-400a-4613-bdb4-62e1fc3b69fe" (UID: "733a97b4-400a-4613-bdb4-62e1fc3b69fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:15:17.541877 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.541860    2573 scope.go:117] "RemoveContainer" containerID="9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"
Jul 21 20:15:17.549678 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.549655    2573 scope.go:117] "RemoveContainer" containerID="cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"
Jul 21 20:15:17.549982 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:17.549961    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846\": container with ID starting with cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846 not found: ID does not exist" containerID="cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"
Jul 21 20:15:17.550070 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.549995    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846"} err="failed to get container status \"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846\": rpc error: code = NotFound desc = could not find container \"cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846\": container with ID starting with cacddb101fcfc03505465620c83a3a0aa4ebf1fec8d158946b01696bbd577846 not found: ID does not exist"
Jul 21 20:15:17.550070 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.550020    2573 scope.go:117] "RemoveContainer" containerID="9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"
Jul 21 20:15:17.550316 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:17.550297    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a\": container with ID starting with 9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a not found: ID does not exist" containerID="9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"
Jul 21 20:15:17.550356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.550322    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a"} err="failed to get container status \"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a\": rpc error: code = NotFound desc = could not find container \"9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a\": container with ID starting with 9697d137f6bb97c2a7991e05fa14a09ffce5a77c583c472018ecdd524283738a not found: ID does not exist"
Jul 21 20:15:17.584132 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.584096    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:17.632987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.632956    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.632987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.632983    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.632987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.632993    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.633220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.633001    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.633220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.633019    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsb9g\" (UniqueName: \"kubernetes.io/projected/733a97b4-400a-4613-bdb4-62e1fc3b69fe-kube-api-access-rsb9g\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.633220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.633031    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/733a97b4-400a-4613-bdb4-62e1fc3b69fe-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:17.653854 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.653815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:17.804878 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.804852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:17.806805 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:17.806767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd81021_714a_4a2c_9a1c_6c0d790fe38f.slice/crio-ece360737d9131464d02c2592a912290bba8ac0e0b2b1e6404b57a4ac15ba790 WatchSource:0}: Error finding container ece360737d9131464d02c2592a912290bba8ac0e0b2b1e6404b57a4ac15ba790: Status 404 returned error can't find the container with id ece360737d9131464d02c2592a912290bba8ac0e0b2b1e6404b57a4ac15ba790
Jul 21 20:15:17.860085 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.860051    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:15:17.867211 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:17.867177    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-839c41-openshift-default-7457c64f5f-nb92r"]
Jul 21 20:15:18.414750 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:18.414701    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" path="/var/lib/kubelet/pods/733a97b4-400a-4613-bdb4-62e1fc3b69fe/volumes"
Jul 21 20:15:18.538336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:18.538301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" event={"ID":"0bd81021-714a-4a2c-9a1c-6c0d790fe38f","Type":"ContainerStarted","Data":"ece360737d9131464d02c2592a912290bba8ac0e0b2b1e6404b57a4ac15ba790"}
Jul 21 20:15:19.545878 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:19.545842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" event={"ID":"0bd81021-714a-4a2c-9a1c-6c0d790fe38f","Type":"ContainerStarted","Data":"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"}
Jul 21 20:15:19.546278 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:19.545975    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:19.574268 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:19.574214    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" podStartSLOduration=2.753687964 podStartE2EDuration="3.574197884s" totalImagesPullingTime="820.50992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:19.573876898 +0000 UTC m=+2287.286661501" watchObservedRunningTime="2026-07-21 20:15:19.574197884 +0000 UTC m=+2287.286982457"
Jul 21 20:15:21.104346 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:21.104312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:21.698154 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:21.698119    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:22.059432 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059400    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:15:22.059785 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059771    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.059829 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059787    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.059829 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059797    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.059829 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059803    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.059946 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059861    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.059946 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.059869    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="733a97b4-400a-4613-bdb4-62e1fc3b69fe" containerName="istio-proxy"
Jul 21 20:15:22.062951 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.062932    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.066906 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.066877    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5c4765-openshift-default-dockercfg-f6fcr\""
Jul 21 20:15:22.091545 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.091481    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:15:22.133361 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.133321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:22.180476 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180476 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28hv6\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180942 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180942 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.180942 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.180815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.239467 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.239431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:22.282291 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282291 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282298    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282544 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282808 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282808 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28hv6\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282808 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.282808 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.283023 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282875    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.283023 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.282972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.283141 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.283053    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.283190 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.283131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.285028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.285001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.285206 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.285184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.294600 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.294569    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.294968 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.294944    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28hv6\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6\") pod \"e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") " pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.375892 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.375814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:22.538973 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.538946    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:15:22.541070 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:22.541043    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b84bd86_2f44_46c2_8c04_63dfbf5d812d.slice/crio-220c6596c34b7e1795986d2ae017fe2beca53d383e04d65d8c70c463acabc939 WatchSource:0}: Error finding container 220c6596c34b7e1795986d2ae017fe2beca53d383e04d65d8c70c463acabc939: Status 404 returned error can't find the container with id 220c6596c34b7e1795986d2ae017fe2beca53d383e04d65d8c70c463acabc939
Jul 21 20:15:22.543237 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.543203    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:22.543332 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.543273    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:22.543373 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.543335    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:22.560811 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:22.560782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerStarted","Data":"220c6596c34b7e1795986d2ae017fe2beca53d383e04d65d8c70c463acabc939"}
Jul 21 20:15:23.571729 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:23.570975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerStarted","Data":"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"}
Jul 21 20:15:23.613215 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:23.613156    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podStartSLOduration=1.6131348220000001 podStartE2EDuration="1.613134822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:23.61288656 +0000 UTC m=+2291.325671158" watchObservedRunningTime="2026-07-21 20:15:23.613134822 +0000 UTC m=+2291.325919399"
Jul 21 20:15:24.376296 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:24.376251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:24.381370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:24.381344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:24.576140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:24.576107    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:24.577000 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:24.576982    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:25.563532 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:25.563496    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:25.809997 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:25.809955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:25.985796 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:25.985762    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:15:25.989502 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:25.989477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:25.997944 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:25.997924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5c4765-serving-cert\""
Jul 21 20:15:26.017897 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.017858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:26.023919 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.023893    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:15:26.124368 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.124333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.124629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.124609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.124778 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.124761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fg6\" (UniqueName: \"kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.223447 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.223405    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:26.225577 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.225554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.225673 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.225600    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.225673 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.225628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fg6\" (UniqueName: \"kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.225856 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:26.225778    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-serving-cert: secret "maas-api-e2e-api-b-5c4765-serving-cert" not found
Jul 21 20:15:26.225923 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:26.225865    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls podName:b0c08c61-4296-4677-9da4-bcfaed8cd7bb nodeName:}" failed. No retries permitted until 2026-07-21 20:15:26.725844675 +0000 UTC m=+2294.438629232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls") pod "maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" (UID: "b0c08c61-4296-4677-9da4-bcfaed8cd7bb") : secret "maas-api-e2e-api-b-5c4765-serving-cert" not found
Jul 21 20:15:26.226285 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.226262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.257893 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.257802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fg6\" (UniqueName: \"kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.707859 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.707776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:26.730481 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.730436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.733160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.733125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") pod \"maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:26.901167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:26.901130    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:27.113125 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:15:27.113094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c08c61_4296_4677_9da4_bcfaed8cd7bb.slice/crio-19ecdbc4b18c48bd25cb2bd6b50bc473a563e88282bac2807f45c59a23e1f1f7 WatchSource:0}: Error finding container 19ecdbc4b18c48bd25cb2bd6b50bc473a563e88282bac2807f45c59a23e1f1f7: Status 404 returned error can't find the container with id 19ecdbc4b18c48bd25cb2bd6b50bc473a563e88282bac2807f45c59a23e1f1f7
Jul 21 20:15:27.125084 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:27.125057    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:15:27.299530 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:27.299458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:27.564049 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:27.564020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:27.591642 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:27.591589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" event={"ID":"b0c08c61-4296-4677-9da4-bcfaed8cd7bb","Type":"ContainerStarted","Data":"19ecdbc4b18c48bd25cb2bd6b50bc473a563e88282bac2807f45c59a23e1f1f7"}
Jul 21 20:15:28.599076 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:28.599031    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" event={"ID":"b0c08c61-4296-4677-9da4-bcfaed8cd7bb","Type":"ContainerStarted","Data":"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"}
Jul 21 20:15:28.599548 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:28.599099    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:28.636677 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:28.636625    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" podStartSLOduration=3.19092678 podStartE2EDuration="3.636606713s" totalImagesPullingTime="445.679933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:28.635370279 +0000 UTC m=+2296.348154873" watchObservedRunningTime="2026-07-21 20:15:28.636606713 +0000 UTC m=+2296.349391285"
Jul 21 20:15:30.190659 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.190628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:30.523641 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.523615    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 20:15:30.523814 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.523669    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 20:15:30.612132 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.612096    2573 generic.go:356] "Generic (PLEG): container finished" podID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerID="a5f25c78d9ea8d54657f486fdf90877c405cf21b92c49e08f4ef95d61ae9c0ca" exitCode=0
Jul 21 20:15:30.612294 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.612154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerDied","Data":"a5f25c78d9ea8d54657f486fdf90877c405cf21b92c49e08f4ef95d61ae9c0ca"}
Jul 21 20:15:30.612577 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.612562    2573 scope.go:117] "RemoveContainer" containerID="a5f25c78d9ea8d54657f486fdf90877c405cf21b92c49e08f4ef95d61ae9c0ca"
Jul 21 20:15:30.613583 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.613550    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:30.613686 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.613636    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:30.613775 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:30.613685    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:31.618823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:31.618786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerStarted","Data":"b81232b98c2e2ffad11d554cb9d861511646d359de5b59162ed1748268e71ce4"}
Jul 21 20:15:32.403552 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:32.403509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:32.403830 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:32.403805    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 20:15:32.403907 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:32.403858    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 20:15:33.403157 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:33.403117    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 20:15:33.403649 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:33.403183    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 20:15:34.403948 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:34.403910    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 20:15:34.404352 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:34.403986    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 20:15:34.611705 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:34.611675    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:15:35.403935 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:35.403889    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 21 20:15:35.404151 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:35.403954    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 21 20:15:36.407005 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:36.406963    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:36.407402 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:36.407232    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:36.407893 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:36.407877    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:15:38.661064 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:38.661028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:38.760336 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:38.760292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:40.616948 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:40.616903    2573 patch_prober.go:28] interesting pod/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 20:15:40.617361 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:40.616991    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 20:15:41.688334 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.688241    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerID="77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4" exitCode=0
Jul 21 20:15:41.688334 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.688315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerDied","Data":"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"}
Jul 21 20:15:41.688800 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.688689    2573 scope.go:117] "RemoveContainer" containerID="77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"
Jul 21 20:15:41.689696 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.689660    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:41.689828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.689762    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:41.689828 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:41.689811    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:15:42.271078 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:42.271033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:42.700052 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:42.699957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerStarted","Data":"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"}
Jul 21 20:15:43.376339 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:43.376267    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:43.376799 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:43.376754    2573 patch_prober.go:28] interesting pod/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 20:15:43.376918 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:43.376885    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 20:15:44.376762 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:44.376689    2573 patch_prober.go:28] interesting pod/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 20:15:44.377177 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:44.376799    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 20:15:45.376834 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:45.376789    2573 patch_prober.go:28] interesting pod/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 20:15:45.377303 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:45.376859    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 20:15:46.376911 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:46.376860    2573 patch_prober.go:28] interesting pod/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 21 20:15:46.377321 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:46.376924    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 21 20:15:47.379952 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:47.379919    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:47.380341 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:47.380256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:47.380908 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:47.380889    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:15:48.571506 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:48.571461    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:48.691964 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:48.691923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:53.861142 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:53.861111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:53.861528 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:53.861325    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" podUID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" containerName="maas-api" containerID="cri-o://dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc" gracePeriod=30
Jul 21 20:15:53.901220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:53.901157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:54.117054 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.116993    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:54.198290 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.198256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwm7w\" (UniqueName: \"kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w\") pod \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") "
Jul 21 20:15:54.198469 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.198321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") pod \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") "
Jul 21 20:15:54.198469 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.198376    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca\") pod \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\" (UID: \"0bd81021-714a-4a2c-9a1c-6c0d790fe38f\") "
Jul 21 20:15:54.198810 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.198785    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0bd81021-714a-4a2c-9a1c-6c0d790fe38f" (UID: "0bd81021-714a-4a2c-9a1c-6c0d790fe38f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:15:54.200438 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.200410    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0bd81021-714a-4a2c-9a1c-6c0d790fe38f" (UID: "0bd81021-714a-4a2c-9a1c-6c0d790fe38f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:15:54.200438 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.200428    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w" (OuterVolumeSpecName: "kube-api-access-wwm7w") pod "0bd81021-714a-4a2c-9a1c-6c0d790fe38f" (UID: "0bd81021-714a-4a2c-9a1c-6c0d790fe38f"). InnerVolumeSpecName "kube-api-access-wwm7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:15:54.299882 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.299848    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:54.299882 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.299880    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:54.300075 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.299890    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwm7w\" (UniqueName: \"kubernetes.io/projected/0bd81021-714a-4a2c-9a1c-6c0d790fe38f-kube-api-access-wwm7w\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:15:54.762189 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.762150    2573 generic.go:356] "Generic (PLEG): container finished" podID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" containerID="dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc" exitCode=0
Jul 21 20:15:54.762392 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.762194    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"
Jul 21 20:15:54.762392 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.762239    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" event={"ID":"0bd81021-714a-4a2c-9a1c-6c0d790fe38f","Type":"ContainerDied","Data":"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"}
Jul 21 20:15:54.762392 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.762301    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw" event={"ID":"0bd81021-714a-4a2c-9a1c-6c0d790fe38f","Type":"ContainerDied","Data":"ece360737d9131464d02c2592a912290bba8ac0e0b2b1e6404b57a4ac15ba790"}
Jul 21 20:15:54.762392 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.762330    2573 scope.go:117] "RemoveContainer" containerID="dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"
Jul 21 20:15:54.770895 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.770829    2573 scope.go:117] "RemoveContainer" containerID="dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"
Jul 21 20:15:54.771135 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:15:54.771115    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc\": container with ID starting with dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc not found: ID does not exist" containerID="dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"
Jul 21 20:15:54.771227 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.771150    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc"} err="failed to get container status \"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc\": rpc error: code = NotFound desc = could not find container \"dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc\": container with ID starting with dd3fe3787c13dd8eb4e65357a3c6f5ce46d63616f6ef036236aaa2e83e0b90fc not found: ID does not exist"
Jul 21 20:15:54.783565 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.783535    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:54.786987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:54.786960    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-661123-5744d577bd-5x8zw"]
Jul 21 20:15:56.415226 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:56.415192    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" path="/var/lib/kubelet/pods/0bd81021-714a-4a2c-9a1c-6c0d790fe38f/volumes"
Jul 21 20:15:58.634528 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:58.634490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:59.068522 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:15:59.068493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:05.362209 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.362123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:05.462322 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.462278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:05.642288 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.642203    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:16:05.642489 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.642448    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" containerID="cri-o://b81232b98c2e2ffad11d554cb9d861511646d359de5b59162ed1748268e71ce4" gracePeriod=30
Jul 21 20:16:05.654926 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.654896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:05.928347 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:05.928255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:06.033062 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.033027    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"]
Jul 21 20:16:06.033363 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.033351    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" containerName="maas-api"
Jul 21 20:16:06.033407 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.033365    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" containerName="maas-api"
Jul 21 20:16:06.033446 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.033422    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd81021-714a-4a2c-9a1c-6c0d790fe38f" containerName="maas-api"
Jul 21 20:16:06.037878 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.037857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:06.040736 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.040695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gbjhg\""
Jul 21 20:16:06.048251 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.048224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"]
Jul 21 20:16:06.204384 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.204294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj\" (UID: \"7b0e045b-609f-4695-9a95-7151e95efdf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:06.305848 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.305802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj\" (UID: \"7b0e045b-609f-4695-9a95-7151e95efdf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:06.306559 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.306541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj\" (UID: \"7b0e045b-609f-4695-9a95-7151e95efdf9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:06.350863 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.350831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:06.410894 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.410859    2573 patch_prober.go:28] interesting pod/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 21 20:16:06.411343 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.410921    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:16:06.490166 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.490131    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"]
Jul 21 20:16:06.493563 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:16:06.493534    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0e045b_609f_4695_9a95_7151e95efdf9.slice/crio-c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb WatchSource:0}: Error finding container c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb: Status 404 returned error can't find the container with id c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb
Jul 21 20:16:06.823173 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.823076    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj" event={"ID":"7b0e045b-609f-4695-9a95-7151e95efdf9","Type":"ContainerStarted","Data":"71d6dea30492b6d5187ca7a824e5e1820618489e1766a85fd70c496983225d46"}
Jul 21 20:16:06.823173 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.823128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj" event={"ID":"7b0e045b-609f-4695-9a95-7151e95efdf9","Type":"ContainerStarted","Data":"c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb"}
Jul 21 20:16:06.841078 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:06.841021    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj" podStartSLOduration=0.841004829 podStartE2EDuration="841.004829ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:16:06.838958132 +0000 UTC m=+2334.551742710" watchObservedRunningTime="2026-07-21 20:16:06.841004829 +0000 UTC m=+2334.553789403"
Jul 21 20:16:07.829191 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:07.829159    2573 generic.go:356] "Generic (PLEG): container finished" podID="7b0e045b-609f-4695-9a95-7151e95efdf9" containerID="71d6dea30492b6d5187ca7a824e5e1820618489e1766a85fd70c496983225d46" exitCode=0
Jul 21 20:16:07.829595 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:07.829241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj" event={"ID":"7b0e045b-609f-4695-9a95-7151e95efdf9","Type":"ContainerDied","Data":"71d6dea30492b6d5187ca7a824e5e1820618489e1766a85fd70c496983225d46"}
Jul 21 20:16:08.963983 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:08.963955    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:09.131631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.131535    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca\") pod \"7b0e045b-609f-4695-9a95-7151e95efdf9\" (UID: \"7b0e045b-609f-4695-9a95-7151e95efdf9\") "
Jul 21 20:16:09.131953 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.131931    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b0e045b-609f-4695-9a95-7151e95efdf9" (UID: "7b0e045b-609f-4695-9a95-7151e95efdf9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:16:09.232416 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.232380    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b0e045b-609f-4695-9a95-7151e95efdf9-maas-api-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:09.839863 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.839825    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj" event={"ID":"7b0e045b-609f-4695-9a95-7151e95efdf9","Type":"ContainerDied","Data":"c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb"}
Jul 21 20:16:09.839863 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.839857    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"
Jul 21 20:16:09.840077 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:09.839902    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6e3180eda5b699ead794bdbeb01f06983dffce96db21de7b6b9e7a85f8e67eb"
Jul 21 20:16:10.846520 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:10.846492    2573 generic.go:356] "Generic (PLEG): container finished" podID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerID="b81232b98c2e2ffad11d554cb9d861511646d359de5b59162ed1748268e71ce4" exitCode=0
Jul 21 20:16:10.846913 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:10.846564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerDied","Data":"b81232b98c2e2ffad11d554cb9d861511646d359de5b59162ed1748268e71ce4"}
Jul 21 20:16:10.846913 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:10.846624    2573 scope.go:117] "RemoveContainer" containerID="a5f25c78d9ea8d54657f486fdf90877c405cf21b92c49e08f4ef95d61ae9c0ca"
Jul 21 20:16:10.905859 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:10.905836    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:16:11.048831 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.048801    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.048846    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.048875    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.048890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049019    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czmj6\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049213    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:11.049324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049253    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy\") pod \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\" (UID: \"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae\") "
Jul 21 20:16:11.049324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049292    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:11.049324 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:16:11.049693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049422    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:11.049693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049593    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.049693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049612    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.049693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049627    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.049693 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.049641    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.050515 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.050488    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:11.051145 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.051114    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:16:11.051333 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.051310    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6" (OuterVolumeSpecName: "kube-api-access-czmj6") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "kube-api-access-czmj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:16:11.051628 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.051601    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:11.051628 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.051614    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" (UID: "cb91a994-0973-4d2e-b2be-4ccecc6ad4ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:16:11.150065 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.150027    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.150065 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.150058    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.150065 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.150067    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.150065 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.150075    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.150320 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.150085    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czmj6\" (UniqueName: \"kubernetes.io/projected/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae-kube-api-access-czmj6\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:11.852241 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.852208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72" event={"ID":"cb91a994-0973-4d2e-b2be-4ccecc6ad4ae","Type":"ContainerDied","Data":"0410fadebff3c1891b634a25141a0b7f5699560776e33da01319591196cb8f75"}
Jul 21 20:16:11.852663 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.852268    2573 scope.go:117] "RemoveContainer" containerID="b81232b98c2e2ffad11d554cb9d861511646d359de5b59162ed1748268e71ce4"
Jul 21 20:16:11.852663 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.852214    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"
Jul 21 20:16:11.879566 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.879544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:16:11.884571 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:11.884547    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-661123-openshift-default-d5b98ddc7-zlr72"]
Jul 21 20:16:12.416152 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:12.416120    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" path="/var/lib/kubelet/pods/cb91a994-0973-4d2e-b2be-4ccecc6ad4ae/volumes"
Jul 21 20:16:21.495673 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.495637    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:16:21.496188 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.495887    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" podUID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" containerName="maas-api" containerID="cri-o://a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1" gracePeriod=30
Jul 21 20:16:21.525679 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.525644    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:21.744256 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.744232    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:16:21.841991 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.841894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca\") pod \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") "
Jul 21 20:16:21.841991 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.841946    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6fg6\" (UniqueName: \"kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6\") pod \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") "
Jul 21 20:16:21.841991 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.841978    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") pod \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\" (UID: \"b0c08c61-4296-4677-9da4-bcfaed8cd7bb\") "
Jul 21 20:16:21.842340 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.842315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0c08c61-4296-4677-9da4-bcfaed8cd7bb" (UID: "b0c08c61-4296-4677-9da4-bcfaed8cd7bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:16:21.844299 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.844267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6" (OuterVolumeSpecName: "kube-api-access-w6fg6") pod "b0c08c61-4296-4677-9da4-bcfaed8cd7bb" (UID: "b0c08c61-4296-4677-9da4-bcfaed8cd7bb"). InnerVolumeSpecName "kube-api-access-w6fg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:16:21.844454 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.844421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0c08c61-4296-4677-9da4-bcfaed8cd7bb" (UID: "b0c08c61-4296-4677-9da4-bcfaed8cd7bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:16:21.904658 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.904621    2573 generic.go:356] "Generic (PLEG): container finished" podID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" containerID="a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1" exitCode=0
Jul 21 20:16:21.904658 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.904661    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"
Jul 21 20:16:21.904875 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.904678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" event={"ID":"b0c08c61-4296-4677-9da4-bcfaed8cd7bb","Type":"ContainerDied","Data":"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"}
Jul 21 20:16:21.904875 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.904747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d" event={"ID":"b0c08c61-4296-4677-9da4-bcfaed8cd7bb","Type":"ContainerDied","Data":"19ecdbc4b18c48bd25cb2bd6b50bc473a563e88282bac2807f45c59a23e1f1f7"}
Jul 21 20:16:21.904875 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.904772    2573 scope.go:117] "RemoveContainer" containerID="a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"
Jul 21 20:16:21.914313 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.914293    2573 scope.go:117] "RemoveContainer" containerID="a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"
Jul 21 20:16:21.914583 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:16:21.914566    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1\": container with ID starting with a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1 not found: ID does not exist" containerID="a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"
Jul 21 20:16:21.914629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.914591    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1"} err="failed to get container status \"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1\": rpc error: code = NotFound desc = could not find container \"a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1\": container with ID starting with a78b68707e1a4ee561b4ecdd995c0f658fddefc34362e3d28f7d0e89779b07b1 not found: ID does not exist"
Jul 21 20:16:21.927182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.927154    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:16:21.930783 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.930761    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5c4765-5b6f48866b-mph8d"]
Jul 21 20:16:21.943611 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.943585    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:21.943611 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.943608    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6fg6\" (UniqueName: \"kubernetes.io/projected/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-kube-api-access-w6fg6\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:21.943752 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:21.943620    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c08c61-4296-4677-9da4-bcfaed8cd7bb-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:22.284400 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:22.284349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:22.395332 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:22.395296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:22.414406 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:22.414377    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" path="/var/lib/kubelet/pods/b0c08c61-4296-4677-9da4-bcfaed8cd7bb/volumes"
Jul 21 20:16:26.112908 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:26.112866    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"]
Jul 21 20:16:26.115448 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:26.115417    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5c4765-t9qfj"]
Jul 21 20:16:26.130198 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:26.130170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:26.415366 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:26.415270    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b0e045b-609f-4695-9a95-7151e95efdf9" path="/var/lib/kubelet/pods/7b0e045b-609f-4695-9a95-7151e95efdf9/volumes"
Jul 21 20:16:26.521630 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:26.521600    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:32.590066 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:32.590029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:32.691089 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:32.691055    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:32.872511 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:32.872421    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:16:32.872699 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:32.872674    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy" containerID="cri-o://3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6" gracePeriod=30
Jul 21 20:16:32.913079 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:32.913046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:33.148131 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.148039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:33.515107 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.515076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:33.924385 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924300    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924610    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924620    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924638    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" containerName="maas-api"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924645    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" containerName="maas-api"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924657    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0e045b-609f-4695-9a95-7151e95efdf9" containerName="revoke-keys"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924662    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0e045b-609f-4695-9a95-7151e95efdf9" containerName="revoke-keys"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924729    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c08c61-4296-4677-9da4-bcfaed8cd7bb" containerName="maas-api"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924738    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:33.924852 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.924745    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0e045b-609f-4695-9a95-7151e95efdf9" containerName="revoke-keys"
Jul 21 20:16:33.929043 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.929023    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:33.932522 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.932501    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-065403-openshift-default-dockercfg-sqkft\""
Jul 21 20:16:33.951398 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.951369    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:16:33.953991 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:33.953967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:34.047423 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqfd9\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047612 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047961 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.047961 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.047669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149042 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149295 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149361 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149413 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfd9\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149466 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149466 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149519    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149545    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149829 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149870 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.149904 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.149881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.151853 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.151820    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.152013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.151997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.160273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.160244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.160638 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.160618    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqfd9\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9\") pod \"e2e-shared-a-065403-openshift-default-677d857559-zpgd5\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") " pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.191604 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.191540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:34.239638 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.239617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:34.380753 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.379948    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:16:34.383755 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:16:34.383697    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd697a84_4334_49c2_b153_5567d175ed5e.slice/crio-b6db33cd6220775647ef700fe1b9e9ac0e67b3c4985ad8fe5593bf807b03d090 WatchSource:0}: Error finding container b6db33cd6220775647ef700fe1b9e9ac0e67b3c4985ad8fe5593bf807b03d090: Status 404 returned error can't find the container with id b6db33cd6220775647ef700fe1b9e9ac0e67b3c4985ad8fe5593bf807b03d090
Jul 21 20:16:34.385957 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.385925    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:34.386037 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.385986    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:34.386037 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.386013    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:34.968133 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.968101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerStarted","Data":"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"}
Jul 21 20:16:34.968512 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.968151    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerStarted","Data":"b6db33cd6220775647ef700fe1b9e9ac0e67b3c4985ad8fe5593bf807b03d090"}
Jul 21 20:16:34.996225 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:34.996172    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podStartSLOduration=1.996155888 podStartE2EDuration="1.996155888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:16:34.995182339 +0000 UTC m=+2362.707966912" watchObservedRunningTime="2026-07-21 20:16:34.996155888 +0000 UTC m=+2362.708940461"
Jul 21 20:16:35.239841 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:35.239761    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:35.244551 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:35.244526    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:35.972964 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:35.972926    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:35.973821 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:35.973799    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:37.029337 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.029291    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:37.121264 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.121231    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:16:37.121577 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.121564    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:37.121638 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.121578    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:37.121638 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.121634    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb91a994-0973-4d2e-b2be-4ccecc6ad4ae" containerName="istio-proxy"
Jul 21 20:16:37.124823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.124798    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.131071 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.131048    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-065403-serving-cert\""
Jul 21 20:16:37.150220 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.150192    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:16:37.160683 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.160647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:37.177987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.177940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxn9w\" (UniqueName: \"kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.178181 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.178061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.178181 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.178140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.262674 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.262629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:37.278855 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.278814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxn9w\" (UniqueName: \"kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.279079 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.278892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.279079 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.278948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.279833 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.279778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.281672 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.281648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.290443 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.290418    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxn9w\" (UniqueName: \"kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w\") pod \"maas-api-e2e-shared-a-065403-c879448dd-5b9qg\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.435235 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.435201    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:37.577644 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.577597    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:16:37.580019 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:16:37.579989    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4281f9ef_306a_4e42_8b2c_36c3cfe4c29e.slice/crio-f6baf25ddc40fd888dcb7ed2e2cc9c6d1a228278b8937ed811337a9a3e7313bd WatchSource:0}: Error finding container f6baf25ddc40fd888dcb7ed2e2cc9c6d1a228278b8937ed811337a9a3e7313bd: Status 404 returned error can't find the container with id f6baf25ddc40fd888dcb7ed2e2cc9c6d1a228278b8937ed811337a9a3e7313bd
Jul 21 20:16:37.736254 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.736222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:37.834978 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.834888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:37.985538 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:37.985505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" event={"ID":"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e","Type":"ContainerStarted","Data":"f6baf25ddc40fd888dcb7ed2e2cc9c6d1a228278b8937ed811337a9a3e7313bd"}
Jul 21 20:16:38.110634 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.110611    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:16:38.186558 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186513    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186558 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186600    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186628    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186663    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28hv6\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186741    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186776    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186822    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.186856 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket\") pod \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\" (UID: \"5b84bd86-2f44-46c2-8c04-63dfbf5d812d\") "
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.186998    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187046    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187112    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187206    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187226    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.187231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:38.187986 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.187954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:38.188967 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.188942    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:16:38.189055 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.188999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:16:38.189337 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.189321    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:16:38.189493 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.189476    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6" (OuterVolumeSpecName: "kube-api-access-28hv6") pod "5b84bd86-2f44-46c2-8c04-63dfbf5d812d" (UID: "5b84bd86-2f44-46c2-8c04-63dfbf5d812d"). InnerVolumeSpecName "kube-api-access-28hv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:16:38.288516 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288490    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288523    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28hv6\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-kube-api-access-28hv6\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288538    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288552    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288568    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288581    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.288635 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.288593    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b84bd86-2f44-46c2-8c04-63dfbf5d812d-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:16:38.848299 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.848248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:38.931568 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.931529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:38.991987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.991957    2573 generic.go:356] "Generic (PLEG): container finished" podID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerID="3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6" exitCode=0
Jul 21 20:16:38.992182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.992015    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"
Jul 21 20:16:38.992182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.992047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerDied","Data":"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"}
Jul 21 20:16:38.992182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.992105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc" event={"ID":"5b84bd86-2f44-46c2-8c04-63dfbf5d812d","Type":"ContainerDied","Data":"220c6596c34b7e1795986d2ae017fe2beca53d383e04d65d8c70c463acabc939"}
Jul 21 20:16:38.992182 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.992139    2573 scope.go:117] "RemoveContainer" containerID="3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"
Jul 21 20:16:38.993827 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.993805    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" event={"ID":"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e","Type":"ContainerStarted","Data":"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"}
Jul 21 20:16:38.993965 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:38.993941    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:39.000930 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.000913    2573 scope.go:117] "RemoveContainer" containerID="77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"
Jul 21 20:16:39.008666 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.008643    2573 scope.go:117] "RemoveContainer" containerID="3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"
Jul 21 20:16:39.008944 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:16:39.008925    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6\": container with ID starting with 3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6 not found: ID does not exist" containerID="3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"
Jul 21 20:16:39.009032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.008955    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6"} err="failed to get container status \"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6\": rpc error: code = NotFound desc = could not find container \"3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6\": container with ID starting with 3a2f6b6ce5b631537ea4e537535c3de1c19c3642139673a4a68370d2fa0d3ff6 not found: ID does not exist"
Jul 21 20:16:39.009032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.008978    2573 scope.go:117] "RemoveContainer" containerID="77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"
Jul 21 20:16:39.009230 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:16:39.009212    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4\": container with ID starting with 77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4 not found: ID does not exist" containerID="77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"
Jul 21 20:16:39.009269 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.009235    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4"} err="failed to get container status \"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4\": rpc error: code = NotFound desc = could not find container \"77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4\": container with ID starting with 77347903f13a1cfda36248bd2dbd90d2f4587d8e1f49fe65cc89cecf2522b5c4 not found: ID does not exist"
Jul 21 20:16:39.023141 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.023116    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:16:39.029887 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.029868    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5c4765-openshift-default-fb7d8bb9-dbxvc"]
Jul 21 20:16:39.071441 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:39.071394    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" podStartSLOduration=1.412758009 podStartE2EDuration="2.071381541s" totalImagesPullingTime="658.623532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:16:39.070651611 +0000 UTC m=+2366.783436195" watchObservedRunningTime="2026-07-21 20:16:39.071381541 +0000 UTC m=+2366.784166110"
Jul 21 20:16:40.415687 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:40.415653    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" path="/var/lib/kubelet/pods/5b84bd86-2f44-46c2-8c04-63dfbf5d812d/volumes"
Jul 21 20:16:41.602565 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:41.602536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:41.949520 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:41.949473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:42.234841 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.234808    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:16:42.235205 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235188    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.235266 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235207    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.235266 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235218    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.235266 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235224    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.235380 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235295    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.235380 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.235306    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b84bd86-2f44-46c2-8c04-63dfbf5d812d" containerName="istio-proxy"
Jul 21 20:16:42.239788 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.239770    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.242607 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.242586    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-464ec4-openshift-default-dockercfg-59wf4\""
Jul 21 20:16:42.254047 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.254023    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:16:42.299043 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.299007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:42.322855 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.322827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.322893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjt62\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.322919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.322959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.323000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323187 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.323049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323187 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.323100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323187 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.323145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.323187 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.323166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.423860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.423820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjt62\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.423860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.423861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.423898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.423934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.423967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424124 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424526 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424588 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.424779 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.424750    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.425061 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.425037    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.425210 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.425185    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.427064 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.427039    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.427164 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.427133    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.442507 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.442481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.449486 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.449459    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjt62\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62\") pod \"e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") " pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.550681 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.550563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:42.727522 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.727490    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:16:42.729397 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:16:42.729368    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0836ea_d4ed_4e26_82eb_0a2af82bd0d0.slice/crio-e289fe709f7791c4426aba17071fb5eb88b72d227f5b7dffa962a9b13c09aff9 WatchSource:0}: Error finding container e289fe709f7791c4426aba17071fb5eb88b72d227f5b7dffa962a9b13c09aff9: Status 404 returned error can't find the container with id e289fe709f7791c4426aba17071fb5eb88b72d227f5b7dffa962a9b13c09aff9
Jul 21 20:16:42.731757 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.731699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:42.731838 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.731805    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:42.731878 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.731847    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:42.774947 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:42.774914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:43.017112 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:43.017075    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerStarted","Data":"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"}
Jul 21 20:16:43.017283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:43.017136    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerStarted","Data":"e289fe709f7791c4426aba17071fb5eb88b72d227f5b7dffa962a9b13c09aff9"}
Jul 21 20:16:43.044579 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:43.044513    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podStartSLOduration=1.044490676 podStartE2EDuration="1.044490676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:16:43.043164422 +0000 UTC m=+2370.755949018" watchObservedRunningTime="2026-07-21 20:16:43.044490676 +0000 UTC m=+2370.757275249"
Jul 21 20:16:43.560761 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:43.559893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:43.568711 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:43.568682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:44.022869 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:44.022836    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:44.023806 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:44.023787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:16:45.006171 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.006144    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:16:45.159743 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.158157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:45.231485 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.231448    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:16:45.234977 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.234949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.237809 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.237777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-464ec4-serving-cert\""
Jul 21 20:16:45.251919 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.251889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:16:45.257760 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.257660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:45.351757 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.351699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:45.353478 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.353443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqf7s\" (UniqueName: \"kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.353762 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.353740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.354041 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.354024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.455074 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.455025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.455283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.455104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqf7s\" (UniqueName: \"kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.455283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.455146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.456099 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.456067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.456217 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:16:45.456198    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-serving-cert: secret "maas-api-e2e-shared-b-464ec4-serving-cert" not found
Jul 21 20:16:45.456286 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:16:45.456267    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls podName:b967873a-c1aa-44fc-8aee-c143b3dae9f1 nodeName:}" failed. No retries permitted until 2026-07-21 20:16:45.956246224 +0000 UTC m=+2373.669030789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls") pod "maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" (UID: "b967873a-c1aa-44fc-8aee-c143b3dae9f1") : secret "maas-api-e2e-shared-b-464ec4-serving-cert" not found
Jul 21 20:16:45.466310 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.466282    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqf7s\" (UniqueName: \"kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.781241 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.781197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:45.959598 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.959551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:45.963013 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:45.962971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") pod \"maas-api-e2e-shared-b-464ec4-5794857f4c-b2842\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:46.021160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:46.021118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:46.121841 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:46.121749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:46.157762 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:46.157698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:46.323432 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:46.323410    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:16:46.325226 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:16:46.325202    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb967873a_c1aa_44fc_8aee_c143b3dae9f1.slice/crio-ce34f63c4862c7451aed011a86bb6ad1e59914d2a1835f82db5be4441470400b WatchSource:0}: Error finding container ce34f63c4862c7451aed011a86bb6ad1e59914d2a1835f82db5be4441470400b: Status 404 returned error can't find the container with id ce34f63c4862c7451aed011a86bb6ad1e59914d2a1835f82db5be4441470400b
Jul 21 20:16:47.039129 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:47.039094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" event={"ID":"b967873a-c1aa-44fc-8aee-c143b3dae9f1","Type":"ContainerStarted","Data":"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"}
Jul 21 20:16:47.039343 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:47.039147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" event={"ID":"b967873a-c1aa-44fc-8aee-c143b3dae9f1","Type":"ContainerStarted","Data":"ce34f63c4862c7451aed011a86bb6ad1e59914d2a1835f82db5be4441470400b"}
Jul 21 20:16:47.039343 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:47.039248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:47.061511 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:47.061455    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" podStartSLOduration=1.664037451 podStartE2EDuration="2.061435279s" totalImagesPullingTime="397.397828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:16:47.058946024 +0000 UTC m=+2374.771730598" watchObservedRunningTime="2026-07-21 20:16:47.061435279 +0000 UTC m=+2374.774219852"
Jul 21 20:16:49.600829 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:49.600742    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:50.054199 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.054168    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd697a84-4334-49c2-b153-5567d175ed5e" containerID="1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2" exitCode=0
Jul 21 20:16:50.054395 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.054245    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerDied","Data":"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"}
Jul 21 20:16:50.054695 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.054679    2573 scope.go:117] "RemoveContainer" containerID="1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"
Jul 21 20:16:50.055691 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.055663    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:50.055774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.055747    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:50.055813 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.055781    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:16:50.972823 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:50.972783    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:51.061503 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:51.061472    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerStarted","Data":"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"}
Jul 21 20:16:51.240637 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:51.240547    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:51.242140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:51.241824    2573 patch_prober.go:28] interesting pod/e2e-shared-a-065403-openshift-default-677d857559-zpgd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 21 20:16:51.242140 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:51.241882    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 21 20:16:52.241142 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:52.241093    2573 patch_prober.go:28] interesting pod/e2e-shared-a-065403-openshift-default-677d857559-zpgd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 21 20:16:52.241656 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:52.241174    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 21 20:16:53.055676 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:53.055635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:16:53.241002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:53.240959    2573 patch_prober.go:28] interesting pod/e2e-shared-a-065403-openshift-default-677d857559-zpgd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 21 20:16:53.241180 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:53.241025    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 21 20:16:54.240597 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:54.240557    2573 patch_prober.go:28] interesting pod/e2e-shared-a-065403-openshift-default-677d857559-zpgd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 21 20:16:54.240936 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:54.240900    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 21 20:16:55.241145 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:55.241103    2573 patch_prober.go:28] interesting pod/e2e-shared-a-065403-openshift-default-677d857559-zpgd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 21 20:16:55.241781 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:55.241703    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 21 20:16:56.255184 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:56.255142    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:56.256398 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:56.256376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:56.263168 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:56.263137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:16:58.598372 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:58.598329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:58.713600 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:16:58.713560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:00.064951 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:00.064902    2573 patch_prober.go:28] interesting pod/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 20:17:00.065357 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:00.065008    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 20:17:01.117707 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.117673    2573 generic.go:356] "Generic (PLEG): container finished" podID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerID="7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff" exitCode=0
Jul 21 20:17:01.118138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.117757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerDied","Data":"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"}
Jul 21 20:17:01.118138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.118133    2573 scope.go:117] "RemoveContainer" containerID="7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"
Jul 21 20:17:01.119104 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.119075    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:17:01.119158 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.119147    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:17:01.119194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:01.119178    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 21 20:17:02.124139 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:02.124108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerStarted","Data":"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"}
Jul 21 20:17:02.552760 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:02.552702    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:17:02.553200 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:02.553169    2573 patch_prober.go:28] interesting pod/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 20:17:02.553332 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:02.553230    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 20:17:03.553149 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:03.553114    2573 patch_prober.go:28] interesting pod/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 20:17:03.553767 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:03.553733    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 20:17:04.551988 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:04.551951    2573 patch_prober.go:28] interesting pod/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 20:17:04.552296 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:04.552266    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 20:17:05.453270 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:05.453227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:05.551467 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:05.551431    2573 patch_prober.go:28] interesting pod/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 21 20:17:05.551773 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:05.551741    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 21 20:17:06.555467 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:06.555434    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:17:06.555987 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:06.555965    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:17:06.556779 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:06.556753    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:17:06.988234 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:06.988199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:07.086323 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:07.086280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:07.804913 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:07.804878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:14.501814 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:14.501788    2573 scope.go:117] "RemoveContainer" containerID="5703079a3d43063d804a6f9597671d834b42b8a939f0378ed10f8b3dfd0f6e2d"
Jul 21 20:17:18.765010 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:18.764968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:17:33.456586 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:17:33.456549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:22.297767 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:19:22.297700    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:49.136033 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:19:49.135990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:50.412031 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:19:50.411993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:03.104772 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:20:03.104739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:23.448141 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:20:23.448103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:49.648262 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:20:49.648182    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:49.748484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:20:49.748451    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:15.171383 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:15.171345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:16.249655 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:16.249618    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:23.154914 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:23.154867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:23.255356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:23.255320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:37.180318 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:37.180272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:59.662669 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:59.662630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:59.763437 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:21:59.763400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:07.750466 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:07.750379    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:07.851325 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:07.851289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:14.555274 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:14.555242    2573 scope.go:117] "RemoveContainer" containerID="71d6dea30492b6d5187ca7a824e5e1820618489e1766a85fd70c496983225d46"
Jul 21 20:22:21.692420 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:21.692392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:52.352607 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:52.352567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:52.453975 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:22:52.453933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:05.846437 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:05.846400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:06.767445 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:06.767413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:27.110778 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:27.110741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:27.212197 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:27.212162    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:37.021057 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.020963    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:23:37.021591 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.021207    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" podUID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" containerName="maas-api" containerID="cri-o://e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905" gracePeriod=30
Jul 21 20:23:37.051168 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.051137    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:37.270051 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.270026    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:23:37.371190 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.371085    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls\") pod \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") "
Jul 21 20:23:37.371374 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.371194    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxn9w\" (UniqueName: \"kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w\") pod \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") "
Jul 21 20:23:37.371374 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.371221    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca\") pod \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\" (UID: \"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e\") "
Jul 21 20:23:37.371593 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.371558    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" (UID: "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:23:37.373186 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.373160    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w" (OuterVolumeSpecName: "kube-api-access-zxn9w") pod "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" (UID: "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e"). InnerVolumeSpecName "kube-api-access-zxn9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:37.373292 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.373230    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" (UID: "4281f9ef-306a-4e42-8b2c-36c3cfe4c29e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:23:37.472770 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.472703    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:37.472770 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.472763    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxn9w\" (UniqueName: \"kubernetes.io/projected/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-kube-api-access-zxn9w\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:37.472770 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.472774    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:37.981972 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.981934    2573 generic.go:356] "Generic (PLEG): container finished" podID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" containerID="e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905" exitCode=0
Jul 21 20:23:37.981972 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.981976    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"
Jul 21 20:23:37.982204 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.981992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" event={"ID":"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e","Type":"ContainerDied","Data":"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"}
Jul 21 20:23:37.982204 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.982035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg" event={"ID":"4281f9ef-306a-4e42-8b2c-36c3cfe4c29e","Type":"ContainerDied","Data":"f6baf25ddc40fd888dcb7ed2e2cc9c6d1a228278b8937ed811337a9a3e7313bd"}
Jul 21 20:23:37.982204 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.982057    2573 scope.go:117] "RemoveContainer" containerID="e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"
Jul 21 20:23:37.994138 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.994116    2573 scope.go:117] "RemoveContainer" containerID="e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"
Jul 21 20:23:37.994423 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:23:37.994401    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905\": container with ID starting with e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905 not found: ID does not exist" containerID="e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"
Jul 21 20:23:37.994462 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:37.994433    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905"} err="failed to get container status \"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905\": rpc error: code = NotFound desc = could not find container \"e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905\": container with ID starting with e352ca0eb1cfa60316b02cd4f73abf200cd4dc5896708583b3a195675d26e905 not found: ID does not exist"
Jul 21 20:23:38.006777 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:38.006753    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:23:38.011604 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:38.011579    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-065403-c879448dd-5b9qg"]
Jul 21 20:23:38.415030 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:38.414941    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" path="/var/lib/kubelet/pods/4281f9ef-306a-4e42-8b2c-36c3cfe4c29e/volumes"
Jul 21 20:23:41.707559 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:41.707516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:42.176994 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:42.176950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:48.414431 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.414395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:48.491169 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.491099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:48.706410 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.706330    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:23:48.706578 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.706555    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy" containerID="cri-o://aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a" gracePeriod=30
Jul 21 20:23:48.734014 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.733972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:48.980043 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:48.979991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:49.641640 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:49.641604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:49.742173 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:49.742135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:53.956553 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:53.956521    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:23:54.021783 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021799    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021841    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqfd9\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021970    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022017 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.021996    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022333 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022333 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket\") pod \"fd697a84-4334-49c2-b153-5567d175ed5e\" (UID: \"fd697a84-4334-49c2-b153-5567d175ed5e\") "
Jul 21 20:23:54.022333 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022242    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:54.022484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022388    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.022484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022452    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:54.022484 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022461    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:23:54.022642 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022602    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:54.022797 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.022765    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:54.024101 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.024069    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9" (OuterVolumeSpecName: "kube-api-access-zqfd9") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "kube-api-access-zqfd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:54.024212 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.024152    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:54.024366 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.024342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:23:54.024366 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.024342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd697a84-4334-49c2-b153-5567d175ed5e" (UID: "fd697a84-4334-49c2-b153-5567d175ed5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:54.059213 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.059173    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd697a84-4334-49c2-b153-5567d175ed5e" containerID="aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a" exitCode=0
Jul 21 20:23:54.059364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.059221    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"
Jul 21 20:23:54.059364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.059250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerDied","Data":"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"}
Jul 21 20:23:54.059364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.059311    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5" event={"ID":"fd697a84-4334-49c2-b153-5567d175ed5e","Type":"ContainerDied","Data":"b6db33cd6220775647ef700fe1b9e9ac0e67b3c4985ad8fe5593bf807b03d090"}
Jul 21 20:23:54.059364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.059335    2573 scope.go:117] "RemoveContainer" containerID="aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"
Jul 21 20:23:54.068669 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.068649    2573 scope.go:117] "RemoveContainer" containerID="1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"
Jul 21 20:23:54.076900 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.076883    2573 scope.go:117] "RemoveContainer" containerID="aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"
Jul 21 20:23:54.077178 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:23:54.077159    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a\": container with ID starting with aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a not found: ID does not exist" containerID="aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"
Jul 21 20:23:54.077262 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.077190    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a"} err="failed to get container status \"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a\": rpc error: code = NotFound desc = could not find container \"aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a\": container with ID starting with aeda5f93c307b61b854a88126b871a608ed1559d0bcff57930a85999e288d74a not found: ID does not exist"
Jul 21 20:23:54.077262 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.077214    2573 scope.go:117] "RemoveContainer" containerID="1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"
Jul 21 20:23:54.077475 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:23:54.077455    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2\": container with ID starting with 1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2 not found: ID does not exist" containerID="1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"
Jul 21 20:23:54.077518 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.077480    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2"} err="failed to get container status \"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2\": rpc error: code = NotFound desc = could not find container \"1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2\": container with ID starting with 1a759c2af994062e70a2c1ca38c2f4354f2f5785b87b4954ebc95a999a4822b2 not found: ID does not exist"
Jul 21 20:23:54.081787 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.081764    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:23:54.086188 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.086167    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-065403-openshift-default-677d857559-zpgd5"]
Jul 21 20:23:54.123583 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123545    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd697a84-4334-49c2-b153-5567d175ed5e-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123583 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123576    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123583 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123587    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd697a84-4334-49c2-b153-5567d175ed5e-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123597    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123608    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123619    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123626    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd697a84-4334-49c2-b153-5567d175ed5e-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.123824 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.123634    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqfd9\" (UniqueName: \"kubernetes.io/projected/fd697a84-4334-49c2-b153-5567d175ed5e-kube-api-access-zqfd9\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:54.415565 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:54.415483    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" path="/var/lib/kubelet/pods/fd697a84-4334-49c2-b153-5567d175ed5e/volumes"
Jul 21 20:23:59.556479 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.556442    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:23:59.556992 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.556748    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" podUID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" containerName="maas-api" containerID="cri-o://f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c" gracePeriod=30
Jul 21 20:23:59.588991 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.588956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:59.802105 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.802074    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:23:59.873798 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.873677    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") pod \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") "
Jul 21 20:23:59.873798 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.873781    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca\") pod \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") "
Jul 21 20:23:59.874030 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.873825    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqf7s\" (UniqueName: \"kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s\") pod \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\" (UID: \"b967873a-c1aa-44fc-8aee-c143b3dae9f1\") "
Jul 21 20:23:59.874171 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.874141    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b967873a-c1aa-44fc-8aee-c143b3dae9f1" (UID: "b967873a-c1aa-44fc-8aee-c143b3dae9f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:23:59.875980 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.875951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s" (OuterVolumeSpecName: "kube-api-access-nqf7s") pod "b967873a-c1aa-44fc-8aee-c143b3dae9f1" (UID: "b967873a-c1aa-44fc-8aee-c143b3dae9f1"). InnerVolumeSpecName "kube-api-access-nqf7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:59.875980 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.875961    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b967873a-c1aa-44fc-8aee-c143b3dae9f1" (UID: "b967873a-c1aa-44fc-8aee-c143b3dae9f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:23:59.975231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.975190    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b967873a-c1aa-44fc-8aee-c143b3dae9f1-maas-api-tls\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:59.975231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.975223    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b967873a-c1aa-44fc-8aee-c143b3dae9f1-openshift-service-ca\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:23:59.975231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:23:59.975234    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqf7s\" (UniqueName: \"kubernetes.io/projected/b967873a-c1aa-44fc-8aee-c143b3dae9f1-kube-api-access-nqf7s\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:00.089459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.089424    2573 generic.go:356] "Generic (PLEG): container finished" podID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" containerID="f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c" exitCode=0
Jul 21 20:24:00.089631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.089466    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"
Jul 21 20:24:00.089631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.089514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" event={"ID":"b967873a-c1aa-44fc-8aee-c143b3dae9f1","Type":"ContainerDied","Data":"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"}
Jul 21 20:24:00.089631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.089566    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842" event={"ID":"b967873a-c1aa-44fc-8aee-c143b3dae9f1","Type":"ContainerDied","Data":"ce34f63c4862c7451aed011a86bb6ad1e59914d2a1835f82db5be4441470400b"}
Jul 21 20:24:00.089631 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.089590    2573 scope.go:117] "RemoveContainer" containerID="f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"
Jul 21 20:24:00.099457 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.099438    2573 scope.go:117] "RemoveContainer" containerID="f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"
Jul 21 20:24:00.099802 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:24:00.099783    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c\": container with ID starting with f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c not found: ID does not exist" containerID="f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"
Jul 21 20:24:00.099860 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.099810    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c"} err="failed to get container status \"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c\": rpc error: code = NotFound desc = could not find container \"f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c\": container with ID starting with f99834cfb57a177e051ec6ee78d99c058b514b13dbc444adec9818864ac7424c not found: ID does not exist"
Jul 21 20:24:00.116098 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.116072    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:24:00.120364 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.120339    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-464ec4-5794857f4c-b2842"]
Jul 21 20:24:00.414700 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:00.414668    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" path="/var/lib/kubelet/pods/b967873a-c1aa-44fc-8aee-c143b3dae9f1/volumes"
Jul 21 20:24:04.211399 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:04.211361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:04.649002 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:04.648965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:10.401246 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.401209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:10.466089 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.466049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:10.696125 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.696039    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:24:10.696290 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.696251    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy" containerID="cri-o://3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982" gracePeriod=30
Jul 21 20:24:10.734965 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.734930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:10.952325 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:10.952229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:12.167005 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:12.166966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:12.247028 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:12.246994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:15.957074 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:15.957047    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:24:16.121167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121167 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121173    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121274    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121296    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121318    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121347    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjt62\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121411 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121391    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo\") pod \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\" (UID: \"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0\") "
Jul 21 20:24:16.121851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121466    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:16.121851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121560    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:24:16.121851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121655    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:16.121851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121705    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istiod-ca-cert\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.121851 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121755    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.122117 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.121896    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:16.122261 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.122236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:16.123566 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.123533    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:24:16.123668 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.123568    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:16.124032 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.124017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:24:16.124095 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.124057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62" (OuterVolumeSpecName: "kube-api-access-gjt62") pod "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" (UID: "0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0"). InnerVolumeSpecName "kube-api-access-gjt62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:24:16.172500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.172468    2573 generic.go:356] "Generic (PLEG): container finished" podID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerID="3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982" exitCode=0
Jul 21 20:24:16.172688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.172525    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"
Jul 21 20:24:16.172688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.172562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerDied","Data":"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"}
Jul 21 20:24:16.172688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.172626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v" event={"ID":"0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0","Type":"ContainerDied","Data":"e289fe709f7791c4426aba17071fb5eb88b72d227f5b7dffa962a9b13c09aff9"}
Jul 21 20:24:16.172688 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.172655    2573 scope.go:117] "RemoveContainer" containerID="3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"
Jul 21 20:24:16.181203 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.181187    2573 scope.go:117] "RemoveContainer" containerID="7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"
Jul 21 20:24:16.188726 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.188695    2573 scope.go:117] "RemoveContainer" containerID="3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"
Jul 21 20:24:16.188964 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:24:16.188943    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982\": container with ID starting with 3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982 not found: ID does not exist" containerID="3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"
Jul 21 20:24:16.189035 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.188977    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982"} err="failed to get container status \"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982\": rpc error: code = NotFound desc = could not find container \"3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982\": container with ID starting with 3a47286cd4078c62fc37fb70a5de6afa6cba2336a4043b931c092e8cf3575982 not found: ID does not exist"
Jul 21 20:24:16.189035 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.189003    2573 scope.go:117] "RemoveContainer" containerID="7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"
Jul 21 20:24:16.189277 ip-10-0-134-115 kubenswrapper[2573]: E0721 20:24:16.189258    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff\": container with ID starting with 7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff not found: ID does not exist" containerID="7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"
Jul 21 20:24:16.189323 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.189283    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff"} err="failed to get container status \"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff\": rpc error: code = NotFound desc = could not find container \"7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff\": container with ID starting with 7a1a606a4e18b6211fa52261be8be0e9a8cd15cfbe29537986a9e49e16b2bdff not found: ID does not exist"
Jul 21 20:24:16.196279 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.196253    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:24:16.201658 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.201637    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-464ec4-openshift-default-9cff94d59-r8d5v"]
Jul 21 20:24:16.223160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223138    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-envoy\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223160 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223159    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-token\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223168    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-credential-socket\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223178    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-workload-certs\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223188    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-data\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223197    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjt62\" (UniqueName: \"kubernetes.io/projected/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-kube-api-access-gjt62\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.223273 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.223205    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0-istio-podinfo\") on node \"ip-10-0-134-115.ec2.internal\" DevicePath \"\""
Jul 21 20:24:16.417888 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:16.417805    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" path="/var/lib/kubelet/pods/0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0/volumes"
Jul 21 20:24:17.446370 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:17.446337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dcdddffd4-klhst_a969bb69-1f0e-41c5-9964-02ac351e0cab/manager/0.log"
Jul 21 20:24:18.122891 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:18.122849    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-nqsdz_36069701-b15e-4a9b-a748-4a65b8f36272/manager/0.log"
Jul 21 20:24:18.133629 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:18.133606    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-nqsdz_36069701-b15e-4a9b-a748-4a65b8f36272/copy-manifests/0.log"
Jul 21 20:24:18.512605 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:18.512575    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74dd9b6d54-k9zjj_28457552-ceff-47ce-9a90-df85fbe143c3/maas-api/0.log"
Jul 21 20:24:18.644085 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:18.644057    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744400-2ltb5_be36befe-d7f0-4250-be44-3d7506a10e81/cleanup/0.log"
Jul 21 20:24:18.765848 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:18.765768    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744415-ws94v_38b0f725-7616-4ee5-89b3-b48b0fbdfe2e/cleanup/0.log"
Jul 21 20:24:21.670963 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:21.670927    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cf6bp_55d1aaa7-98e4-4e04-b715-9838124096ff/discovery/0.log"
Jul 21 20:24:22.414338 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:22.414303    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-549576786b-wcctq_7e30b05e-c759-491a-a39f-152acafe84d1/router/0.log"
Jul 21 20:24:22.919694 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:22.919660    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jr6pg_ac7d0782-d416-493e-821b-04929c5d9f1a/main/0.log"
Jul 21 20:24:23.172512 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:23.172433    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fnjnx8_c586026f-f9b9-4ae7-945f-550143772aba/main/0.log"
Jul 21 20:24:29.567735 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:29.567683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:29.656414 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:29.656381    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:32.315517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:32.315486    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rm4nq_90c50097-f13b-49ee-b90b-73c984d779e6/global-pull-secret-syncer/0.log"
Jul 21 20:24:32.366945 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:32.366914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-24ln4_804971ce-9fbd-4f02-a2f0-d670bfda1379/konnectivity-agent/0.log"
Jul 21 20:24:32.455662 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:32.455634    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-115.ec2.internal_8a29197a2a94d2c43d1d11c59bf640ff/haproxy/0.log"
Jul 21 20:24:39.671251 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:39.671222    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-dx5xd_84d43cad-9f2f-4115-80b3-a44bf347b1c3/monitoring-plugin/0.log"
Jul 21 20:24:39.767576 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:39.767550    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr59v_47961dc6-2f66-4bc8-89b9-007a34b58ce2/node-exporter/0.log"
Jul 21 20:24:39.788969 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:39.788943    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr59v_47961dc6-2f66-4bc8-89b9-007a34b58ce2/kube-rbac-proxy/0.log"
Jul 21 20:24:39.820356 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:39.820287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr59v_47961dc6-2f66-4bc8-89b9-007a34b58ce2/init-textfile/0.log"
Jul 21 20:24:40.287406 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.287382    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/thanos-query/0.log"
Jul 21 20:24:40.310066 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.310038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/kube-rbac-proxy-web/0.log"
Jul 21 20:24:40.339609 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.339581    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/kube-rbac-proxy/0.log"
Jul 21 20:24:40.357407 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.357382    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/prom-label-proxy/0.log"
Jul 21 20:24:40.381668 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.381643    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/kube-rbac-proxy-rules/0.log"
Jul 21 20:24:40.401597 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:40.401571    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7499f8dfb4-ft8zq_5aedb61e-36b8-49fe-8ff6-8c99ce6b0ae1/kube-rbac-proxy-metrics/0.log"
Jul 21 20:24:42.529278 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529240    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"]
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529567    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529578    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529592    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529600    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529608    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529614    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529623    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529629    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529640    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529645    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529695    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b967873a-c1aa-44fc-8aee-c143b3dae9f1" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529705    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd697a84-4334-49c2-b153-5567d175ed5e" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529712    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4281f9ef-306a-4e42-8b2c-36c3cfe4c29e" containerName="maas-api"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529733    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.529774 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.529738    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0836ea-d4ed-4e26-82eb-0a2af82bd0d0" containerName="istio-proxy"
Jul 21 20:24:42.532931 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.532910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.536556 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.536527    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvhf7\"/\"kube-root-ca.crt\""
Jul 21 20:24:42.537110 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.537095    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvhf7\"/\"openshift-service-ca.crt\""
Jul 21 20:24:42.537769 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.537753    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cvhf7\"/\"default-dockercfg-mzxhw\""
Jul 21 20:24:42.549727 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.549690    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"]
Jul 21 20:24:42.625620 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.625589    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6phk\" (UniqueName: \"kubernetes.io/projected/7c0452bb-1da4-4011-87b0-67af9a893df2-kube-api-access-p6phk\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.625620 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.625629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-lib-modules\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.625868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.625699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-podres\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.625868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.625763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-sys\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.625868 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.625785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-proc\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726283 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6phk\" (UniqueName: \"kubernetes.io/projected/7c0452bb-1da4-4011-87b0-67af9a893df2-kube-api-access-p6phk\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-lib-modules\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-podres\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726395    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-sys\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726491 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-proc\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726690 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-proc\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726690 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-lib-modules\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726690 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726527    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-sys\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.726690 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.726530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c0452bb-1da4-4011-87b0-67af9a893df2-podres\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.734952 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.734925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6phk\" (UniqueName: \"kubernetes.io/projected/7c0452bb-1da4-4011-87b0-67af9a893df2-kube-api-access-p6phk\") pod \"perf-node-gather-daemonset-nwndt\" (UID: \"7c0452bb-1da4-4011-87b0-67af9a893df2\") " pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.843155 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.843062    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:42.980818 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:42.980783    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"]
Jul 21 20:24:42.984050 ip-10-0-134-115 kubenswrapper[2573]: W0721 20:24:42.984019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c0452bb_1da4_4011_87b0_67af9a893df2.slice/crio-bc8696c9209403e9c579a423f04cf243a45d72de4bff2c574c56e5856833ca14 WatchSource:0}: Error finding container bc8696c9209403e9c579a423f04cf243a45d72de4bff2c574c56e5856833ca14: Status 404 returned error can't find the container with id bc8696c9209403e9c579a423f04cf243a45d72de4bff2c574c56e5856833ca14
Jul 21 20:24:43.295706 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:43.295671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt" event={"ID":"7c0452bb-1da4-4011-87b0-67af9a893df2","Type":"ContainerStarted","Data":"fc44d273e8ca03190e08f185d846f6e7d4ecdcadeff0e0b321306434bdf46c95"}
Jul 21 20:24:43.295909 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:43.295753    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:43.295909 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:43.295775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt" event={"ID":"7c0452bb-1da4-4011-87b0-67af9a893df2","Type":"ContainerStarted","Data":"bc8696c9209403e9c579a423f04cf243a45d72de4bff2c574c56e5856833ca14"}
Jul 21 20:24:43.313209 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:43.313159    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt" podStartSLOduration=1.3131433829999999 podStartE2EDuration="1.313143383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:43.312201098 +0000 UTC m=+2851.024985683" watchObservedRunningTime="2026-07-21 20:24:43.313143383 +0000 UTC m=+2851.025927956"
Jul 21 20:24:44.577926 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:44.577895    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z72kl_f7022438-4ba5-472b-ad33-edbe05ddf92a/dns/0.log"
Jul 21 20:24:44.595755 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:44.595704    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z72kl_f7022438-4ba5-472b-ad33-edbe05ddf92a/kube-rbac-proxy/0.log"
Jul 21 20:24:44.659671 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:44.659643    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slgpm_4030f7e4-0205-4571-8678-f00d0a7c50fb/dns-node-resolver/0.log"
Jul 21 20:24:45.256184 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:45.256153    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvc5w_8e3ee25e-530d-42c4-b9b1-67664ee2001e/node-ca/0.log"
Jul 21 20:24:46.399194 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:46.399157    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cf6bp_55d1aaa7-98e4-4e04-b715-9838124096ff/discovery/0.log"
Jul 21 20:24:46.579384 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:46.579351    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-549576786b-wcctq_7e30b05e-c759-491a-a39f-152acafe84d1/router/0.log"
Jul 21 20:24:47.317679 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:47.317645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nhd92_dd0b194b-49af-4709-b1c4-768e6739264e/serve-healthcheck-canary/0.log"
Jul 21 20:24:47.949372 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:47.949334    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqkvv_0a50bd7c-e332-4367-ae6b-4e52d9feb79a/kube-rbac-proxy/0.log"
Jul 21 20:24:47.973459 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:47.973430    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqkvv_0a50bd7c-e332-4367-ae6b-4e52d9feb79a/exporter/0.log"
Jul 21 20:24:47.997183 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:47.997155    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqkvv_0a50bd7c-e332-4367-ae6b-4e52d9feb79a/extractor/0.log"
Jul 21 20:24:49.310545 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:49.310518    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cvhf7/perf-node-gather-daemonset-nwndt"
Jul 21 20:24:50.653186 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:50.653140    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dcdddffd4-klhst_a969bb69-1f0e-41c5-9964-02ac351e0cab/manager/0.log"
Jul 21 20:24:51.005475 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:51.005448    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-nqsdz_36069701-b15e-4a9b-a748-4a65b8f36272/manager/0.log"
Jul 21 20:24:51.047966 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:51.047940    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f74b88589-nqsdz_36069701-b15e-4a9b-a748-4a65b8f36272/copy-manifests/0.log"
Jul 21 20:24:52.315517 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:52.315483    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bc6b5d4fd-96z6c_8ef170b6-8902-4b0a-bbc7-0efb7b0d4a1f/manager/0.log"
Jul 21 20:24:52.806457 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:52.806365    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cf6bp_55d1aaa7-98e4-4e04-b715-9838124096ff/discovery/0.log"
Jul 21 20:24:53.088231 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:53.088115    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-549576786b-wcctq_7e30b05e-c759-491a-a39f-152acafe84d1/router/0.log"
Jul 21 20:24:54.621519 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:54.621485    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cf6bp_55d1aaa7-98e4-4e04-b715-9838124096ff/discovery/0.log"
Jul 21 20:24:54.774907 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:54.774868    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-549576786b-wcctq_7e30b05e-c759-491a-a39f-152acafe84d1/router/0.log"
Jul 21 20:24:59.328510 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.328482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/kube-multus-additional-cni-plugins/0.log"
Jul 21 20:24:59.353249 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.353172    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/egress-router-binary-copy/0.log"
Jul 21 20:24:59.376389 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.376362    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/cni-plugins/0.log"
Jul 21 20:24:59.395906 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.395872    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/bond-cni-plugin/0.log"
Jul 21 20:24:59.416046 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.416023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/routeoverride-cni/0.log"
Jul 21 20:24:59.438105 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.438086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/whereabouts-cni-bincopy/0.log"
Jul 21 20:24:59.461393 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.461363    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mdm_b64fc516-c7de-4c78-bbb2-3085168c83ae/whereabouts-cni/0.log"
Jul 21 20:24:59.670765 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.670658    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pw9bq_e9bdf129-56e9-427e-b80d-5f1d748f7720/kube-multus/0.log"
Jul 21 20:24:59.777130 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.777024    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhb84_5074fdf4-ca29-4d4c-b09a-9b0c79a485f3/network-metrics-daemon/0.log"
Jul 21 20:24:59.796846 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:24:59.796820    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhb84_5074fdf4-ca29-4d4c-b09a-9b0c79a485f3/kube-rbac-proxy/0.log"
Jul 21 20:25:00.687819 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.687790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/ovn-controller/0.log"
Jul 21 20:25:00.714490 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.714463    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/ovn-acl-logging/0.log"
Jul 21 20:25:00.748128 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.748098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/kube-rbac-proxy-node/0.log"
Jul 21 20:25:00.782105 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.782055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/kube-rbac-proxy-ovn-metrics/0.log"
Jul 21 20:25:00.802333 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.802301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/northd/0.log"
Jul 21 20:25:00.825500 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.825471    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/nbdb/0.log"
Jul 21 20:25:00.844228 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.844204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/sbdb/0.log"
Jul 21 20:25:00.930667 ip-10-0-134-115 kubenswrapper[2573]: I0721 20:25:00.930634    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qc2b_d39a08a2-7f02-4332-adec-e44912128da2/ovnkube-controller/0.log"